Assessment Report – Purchases Survey Statistics

Understanding what goods and services businesses purchase, and from whom, is essential to building an accurate picture of the economy. ONS uses its Annual Purchases Survey as the basis for estimating the value of goods and services that businesses use as part of their production processes – in the National Accounts called ‘intermediate consumption’.

ONS previously ran a Purchases Inquiry, with the most-recent usable results relating to 2004. The survey was suspended in 2007, but this suspension became permanent. There followed a ten-year period where no data were collected on intermediate consumption patterns, following which ONS introduced the Annual Purchases Survey to collect data from 2015 onwards.

The hiatus meant that ONS was relying on outdated information about purchases at a time when substantial changes are taking place to purchasing patterns and production processes, not least in the light of the global financial crisis in 2008. ONS mitigated the effects of this to some extent by adjusting its modelled estimates of intermediate consumption based on additional data from the Annual Business Survey, HM Treasury and the Ministry for Housing, Communities and Local Government. In addition, ONS boosted the resources dedicated to manual balancing using staff members’ specific knowledge and broad economic experience. Estimates of intermediate consumption also fell short of EU best practice of updating the supply-use information at least every five years.

We recognise the significant challenges and costs that ONS faces to collect purchases data, and the significant work that it has done to date. We also recognise ONS’s ambitions to achieve National Statistics status, which means that the statistics meet the highest standards of public value, are high quality and are produced in a way worthy of trust and comply with all aspects of the Code of Practice for Statistics.

This report documents the findings of our assessment, which has focused on key elements of quality and value.

 

Related Links:

Letter – Ed Humpherson to Jonathan Athow (December 2019)

Assessment of 2021 Censuses in the UK – Preliminary findings

The Census is one of the most important sources of official statistics, informing decisions about almost every aspect of life within the UK. It is of fundamental importance in allocating billions of pounds to local areas by the UK government and devolved administrations, as well as grants to voluntary sector organisations. The Census helps every person in the UK get a better understanding of the places in which they live and work.

The real value of the Censuses will be realised on the release of Census outputs. Census offices will have to deliver high quality data and statistics in a variety of forms to support the wide range of different uses required. It is essential that the data and statistics from the 2021 Censuses produced by the Office for National Statistics (ONS), the National Records of Scotland (NRS) and the Northern Ireland Statistics and Research Agency (NISRA) are reliable and provide valuable insights, meeting the rigorous standards of trustworthiness, quality and value outlined in the Code of Practice for Statistics.

Our assessment report identifies a range of preliminary findings from the assessment of 2021 Censuses in the UK, which require action on behalf of Census offices to improve compliance with the Code. These findings build on the existing work being undertaken by Census offices and should provide further direction and focus on pre-existing plans for Census as we move toward Census day in 2021 and beyond.

We expect Census offices to act on these findings as part of enhancing the public value, quality and trustworthiness of the data and statistics from 2021 Censuses in the UK. We encourage Census offices to work collaboratively to address the findings. We expect Census offices to report back to us by May 2020, providing an update on progress.

The UK Statistics Authority will decide whether to confirm the National Statistics designation, based on OSR’s advice, prior to publication of Census outputs in 2022; Census offices’ actions to address these findings will help inform that advice.

We have shared this assessment report with relevant UK Parliamentary committees.

 

Related Links:

Letter from Ed Humpherson to NRS, NISRA and ONS (October 2019)

Statistics on Avoidable Mortality

An assessment of the trustworthiness, quality and public value of the Office for National Statistics’ (ONS) Avoidable Mortality statistics.


Judgement on National Statistics status

Users value ONS’s statistics on Avoidable Mortality, recognise the high standards applied in their production, and consider them to be trustworthy. We judge that these can be designated as National Statistics once ONS have taken the three actions outlined in the report to ensure the statistics meet the highest standards of the Code of Practice for Statistics.


Key findings

ONS first published Avoidable Mortality statistics as experimental statistics in May 2012 following user demand from a range of organisations. From the outset, the definitions applied and analyses conducted have been shaped by input from users, and this continues today.

The statistical team is committed to regularly reviewing the avoidable mortality definition to ensure it keeps up-to-date with advances in treatments and public health interventions.

Currently the team liaises with users of these statistics by various means and has now established a new stakeholder interest group to consult with and involve in decisions more regularly and efficiently. This will help ensure the statistics remain relevant to users and further enhance the transparency of decisions taken.

The statistical team recognises that some users would prefer the headline statistics to be released sooner and for additional analyses to be released alongside the main bulletin. We support the team’s efforts to speed up the production and release of the statistics. Communication of these plans is important and the new stakeholder interest group will help to ensure that users of the statistics are involved in, and more informed about, decisions around release timing.

Based on the detailed published methodology documents and the views of clinical experts, we are confident that sound methods are used to produce these statistics and appropriate steps are taken to arrive at suitable definitions, assure the quality of the underlying data and conduct the analysis.

Independent and highly specialised medical and public health advice is provided by an internationally recognised expert in clinical coding who seeks additional input from other experts where necessary. This advice is critical to ensuring that definition decisions are taken appropriately. ONS should ensure that it works with relevant experts to develop a succession plan to ensure that continuity is maintained if a change of advisor occurs.

ONS has committed to provide more information to reflect the recent expansion of the statistics to include data from Scotland and Northern Ireland, where there are different approaches to assure the quality of death recording.

The statisticians demonstrate strong expertise and sound professional judgement. Improvements to the transparency of some processes and decisions have been made in the course of this assessment; we have no further requirements here.


Related Links:

Confirmation as National Statistics (March 2019)

Ed Humpherson to Iain Bell (November 2018)

Ed Humpherson to Amy Wilson (November 2018)

Compliance check: Transparency and communication of International Passenger Survey methods changes

This report looks at the communications around the International Passenger Survey (IPS) related to methods changes implemented between September 2017 and April 2018. It looks at how changes to the IPS data collection methods were communicated in advance of their introduction, how the Office for National Statistics communicated delays to IPS publications, and how quality concerns were conveyed to enable appropriate use of IPS data collected during the transition period.


Related Links

Ed Humpherson to Iain Bell (October 2018)

Ed Humpherson to Guy Goodwin (October 2018)

Iain Bell to Ed Humpherson (June 2018)

Guy Goodwin to Ed Humpherson (June 2018)

Ed Humpherson to Guy Goodwin (June 2018)

 

 

UK and Northern Ireland House Price Indices (Phase 2) – HM Land Registry and partners

House price statistics are key economic indicators and provide important insights into the wider economy and society by helping users to understand trends in the UK and the Northern Ireland housing markets. Economic policy makers use the indices to assess impacts on both the demand and supply sides of the economy, to inform decisions about household consumption and inflationary effects arising from changing prices, the health of the construction industry, the affordability of housing for new housing market entrants, and the capacity of the finance sector to extend credit to households and businesses to support home ownership and investment.

This Assessment covers the new UK House Price Index (UK HPI) developed by HM Land Registry in partnership with the Office for National Statistics (ONS), Registers of Scotland (RoS) and Land & Property Services Northern Ireland (LPS). It also covers the Northern Ireland House Price Index (NI HPI) produced by LPS. This Assessment is the second of a two-phase assessment process triggered in response to a recommendation from the 2010 National Statistician’s Review of House Price Indices, and incorporates the partners’ response to the phase 1 findings.

Our Assessment has identified some areas where the partners could add more public value to these statistics. It shows that the new UK HPI and the NI HPI are already widely valued by a range of different users and points to areas where HM Land Registry and partners must build on the progress already made in establishing the UK HPI as a key economic indicator to maximise its public value. An essential element of this will be for the statisticians to ensure that the UK HPI represents a robust estimate of the change in average house prices with acceptable revisions. The report also finds that HM Land Registry and partners should strengthen their arrangements to better manage the development of statistical methods, and reinforce confidence and broader public value by setting a clear strategy for the indices future development while proactively engaging with a wide range of different users on an ongoing basis. The report also recommends that LPS statisticians look for opportunities to draw on any relevant insights obtained during UK HPI’s development to further enhance NI HPI’s overall public value. The deadline for meeting the Assessment requirements is the end of March 2018.

Related Links

Ed Humpherson to Graham Farrant – National Statistics confirmation (September 2018)

Ed Humpherson to Graham Farrant (November 2017)

Ed Humpherson to Siobhan Carey (November 2017)

UK and Northern Ireland House Price Indices (Phase 1)

Statistics on Regional Gross Value Added: Phase 1

R-GVA statistics are an essential part of what makes up the economic intelligence of the nations and regions of the UK, informing areas such as the development of economic policy and debates and what causes the UK’s productivity growth. Policymakers need to dive deep beneath the statistical surface to understand the economy region-by-region, city-by-city, town-by-town, industry-by-industry, and household-by-household. The R-GVA statistics make some of these deep dives possible, particularly those using different economic geographies drilling to very low levels of geography such as GVA at Local Authority levels in the UK and GVA at Local Enterprise Partnership levels.

This assessment consists of two phases. In this Assessment Report we present the findings of Phase 1 where we have covered ONS’s current R-GVA statistics; in the second phase, we will assess new balanced estimates which ONS intends to publish at the end of 2017. Our Report confirms the designation of the income-based R-GVA measure as National Statistics subject to ONS making a range of improvements to the statistics. We will also confer National Statistics designation on the R-GVA (production approach) measures, once ONS has demonstrated that it has satisfactorily addressed the Requirements in the report to increase the public value and quality of these statistics.

Our Assessment has identified a range of Requirements for ONS to add more public value to these statistics. These Requirements consist of reviews of methods for deflating regional estimates of imputed rent and to apportion more accurately to regions and nations the GVA of the Financial Services and Insurance Industry. Other Requirements point to the need to enhance relationships with government users and consider partnership opportunities with regional analysts.

Meeting the range of Requirements will result in ONS enhancing the value of R-GVA statistics through improvements to quality, with timelier statistics and increased use. Some of the improvements will be achieved within a short space of time before the annual December publication whilst other improvements involve longer-term research, and multi-team decisions and planning which will require a consideration of processes and dependencies across ONS economic statistics teams.


Update 31 October 2017:

ONS has published an action plan in response to our assessment of Regional Gross Value Added (Assessment Report 335). We welcome ONS’s action plan, and will review ONS’s actions once they’re complete.


Related links:

Statistics on Regional Gross Value Added: Phase 2 Assessment Report 335 (June 2018)

Ed Humpherson to Jonathan Athow (August 2017)

Ed Humpherson to Jonathan Athow (June 2018)

Ed Humpherson to Jonathan Athow (August 2018)