Compliance Check of National Population Projections

Dear all

NATIONAL POPULATION PROJECTIONS

I am writing to you following our recent review against the Code of Practice for Statistics of the three National Population Projections published by ONS, NRS and NISRA:

I am pleased to be able to confirm that the National Population Projections should continue to be designated as National Statistics.

In considering the statistics against the three pillars of the Code – Trustworthiness, Quality and Value – we found many encouraging behaviours and practices, which help to ensure that these statistics serve the needs of users. Across the three producer teams, we have been impressed by the commitment and professionalism of the statisticians and analysts that we have spoken to. We particularly welcome the collaborative working of the teams through the National Population Projections Committee and the involvement of subject experts when agreeing on methods and assumptions. We also found some common areas where we consider that improvements should be made to better support users:

  • Be transparent about your planned developments for the projections, your approach to public engagement with users and your progress towards meeting your set priorities and objectives
  • Consider, in conjunction with users, how some additional key information on quality, rationale for methods, limitations and the uses of statistics might be helpfully brought forward into the main bulletin to further add value
  • Consider how to balance possible user interest in a wider range of variants to enhance value, with the need to provide appropriate caveating to help ensure informed and appropriate use.

Each producer has different strengths and areas where they might make improvements. Through working together to share good practice, expertise and resource, your teams could provide a more common and enhanced user experience across the three National Population Projections.

ONS’s National Population Projections bulletin is readable and concise with a range of supporting documents for users to draw on. ONS told us about plans to develop a new tool to allow the production of tailored variant projections to meet the needs of expert users; this reflects the team’s motivation to improve the statistics and recognise users’ needs. The decisions on methods and assumptions are informed by subject experts, consulted on, and agreed in conjunction with the other producers; this ensures the projections are underpinned by sound methods, and the approach taken is considered and reviewed by ONS. Information on the approach to agree the assumptions is published in supporting documentation; this could helpfully be supplemented by a high-level summary which would be beneficial for users. Also, the rationale behind the assumptions could be more prominently presented in the bulletin to avoid users having to delve into the detail to understand them. ONS produces a wide range of good information on the quality of the statistics. However, there is a lot of material and some documents are not straightforward to access. ONS could improve and add value by reviewing the range and accessibility of the supporting information on quality and methods to make it easier for users to find the information they need.

NRS’s National Population Projections are accessibly presented in a variety of formats. The main bulletin presents findings structured as responses to a series of topic-based questions; this presentation is one example of the way the team has produced engaging and accessible content with users in mind. NRS has strong links with a core user group and supports users’ needs for additional statistics such as supplementary variant projections. NRS could refresh and strengthen some of its supporting information on the quality of the statistics including providing explanations of quality matters in the Scottish context and making clearer reference to materials published by ONS. In doing so NRS would provide users with the appropriate quality information to support their use of these statistics.

NISRA’s National Population Projections are presented as a comprehensive package and the users are given a good sense of the value of the statistics through broad use cases included in the bulletin and supporting information. NISRA has produced and published comprehensive documentation on the quality assurance of administrative data; it is clear the team has carefully considered potential data quality issues. NISRA could improve the accessibility of the bulletin by reviewing its readability and the level of insight contained within the narrative. Improving the clarity and insight of the bulletin will help users better engage with the information and support their understanding of the statistics.

We have shared more-detailed comments and findings from our review with your teams. We recommend that you consider our findings and how you will address these areas ahead of the next publication of each of your national projections. We also recommend that you consider whether similar improvements may also be applicable to your subnational population projections. Our population domain leads will continue to engage with your teams over the coming months to discuss progress and provide support as appropriate ahead of the next publication of the national projections.

I am copying this letter to Andrew Nash (ONS), Denise Patrick (NRS) and Jonathan Harvey (NISRA), the lead statisticians.

Yours sincerely,

Mark Pont
Assessment Programme Lead

DCMS Sectors Economic Estimates

Ed Humpherson, Director General for Regulation to Jackie Orme, Head of Profession for Statistics, Department for Digital, Culture, Media and Sport


Dear Jackie,

ASSESSMENT OF DCMS SECTORS ECONOMIC ESTIMATES

Thank you for inviting us to assess DCMS Sectors Economic Estimates against the Code of Practice for Statistics. We have completed the assessment and have today published our Assessment Report. I am grateful for the positive contribution of your staff and for their engagement throughout the assessment process.

DCMS Sector Economic Estimates estimate the contribution of DCMS Sectors to the UK economymeasured by GVA, regional GVA, Employment, Trade and Business. They cover Civil Society, the Creative Industries, the Cultural Sector, the Digital Sector, Gambling, Sport, Telecoms and Tourism. We welcome the commitment of DCMS’s statisticians to developing these innovative statistics to describe this complex landscape to meet user needs, and their commitment to publishing these in line with the Code of Practice for Statistics. Our report highlights many examples of good practice as identified in the assessment. In particular:

• It is clear that the team has continuously sought and responded to user feedback to improve the value of these statistics, and that the team has very good relationships with many of its stakeholders.
• The team has sought and taken on board feedback from the Government Statistical Service Good Practice Team to significantly improve the clarity and layout of the publications.
• We welcome the way the team has worked with the Office for National Statistics to draw on its expertise of complex data sources, and to develop estimates that can be compared with those which describe the whole UK economy.

We judge that the DCMS Economic Estimates can be designated as National Statistics once we have confirmed that the six requirements set out in the report have been met. This will demonstrate that your statistics meet the highest standards of trustworthiness, quality and public value and comply with the Code of Practice for Statistics. You are due to report back to us by 28 February 2019 outlining how you have addressed the requirements.

One of these requirements is to plan a refresh of the sector definitions, to introduce greater consistency in the approaches used to define the sectors and subsectors. The refresh should lead to a set of estimates that meet the needs of stakeholders across a broader range of sub-sectors, in addition to meeting DCMS’s requirement to understand the aggregate position. We will review the statistics again once the refresh has been implemented to ensure continued improvement in the quality of the estimates.

Please feel free to discuss any aspect of this with me or my team at any time.

Yours sincerely,

Ed Humpherson


Related Links:

Assessment of DCMS Sectors Economic Estimates