Siobhan

What does it mean to be an accredited official statistic?

In our latest blog one of our Head Statistics Regulators discusses what it means to be an accredited official statistic and how official statistics accreditation can help users and producers of statistics…

Here at the OSR we are responsible for carrying out assessments to determine whether a set of statistics can be confirmed as accredited official statistics – a designation previously known as badged as National Statistics.

I often get asked what does it mean to be an accredited official statistic?

The OSR defines accredited official statistics as official statistics that we have independently reviewed and confirmed as complying with the standards of trustworthiness, quality and value in the Code of Practice for Statistics (the Code).

For me, accreditation is a shortcut. It’s a quick way of signalling to users of the statistics that the standards of the Code have been met. It’s similar to a quality mark, but what quality is being assessed: that of the processes to produce the statistics or that of the statistics themselves?

“It’s more than just quality”

The Code encompasses much more than quality. Accreditation implies not only the good quality of the statistics themselves but also that they are presented, quality assured and disseminated according to set standards. It is about the value of the statistics for users and whether they are robust enough to bear the weight of decision-making required of them. Thus, accreditation considers both the processes and the statistics themselves and the structures, people and organisations, that support statistics planning, production and communication.

“Context and use matter”

When we assess the quality of the statistics themselves we are not looking for them to meet a ‘gold standard’. We recognise that any statistic is only ever a best estimate at a particular point in time. It also depends on context and whether the statistics are good enough for their intended use, which will vary according to user and societal need. For example more-timely but less-accurate data (due to gaps in data sources to ensure timeliness) may be acceptable in one context but would not be in another. It can take two years after the reference period for a relatively comprehensive picture of the economy and so GDP, to emerge. However, more-timely GDP statistics are needed to inform policy, budgeting, investment and employment decisions in the public and private sectors.

However, what we do require is for producers of statistics to ensure that they are producing the most appropriate estimate available by ensuring suitable data sources are used, methods are robust and estimates are quality assured. This work should be carried out with the context and use of the statistics in mind and in an open, professional and transparent way, by making clear any limitations to the data, inherent uncertainty due to the timeliness of the data, or planned revisions so users can use the statistics appropriately for their needs. More detail on our approach to quality is provided in our publication Quality and statistics: An OSR perspective.

What if the statistics are not accredited?

If statistics are not accredited, it doesn’t mean that they aren’t trustworthy, of a high quality or valuable. It also doesn’t mean that they are. What it does mean though is that we haven’t independently checked that they comply with the standards of trustworthiness, quality and value in the Code. Being a chartered naval architect or having a plumbing and heating qualification signals that someone external has checked you can do something to a particular standard, e.g. build and design ships or install and maintain boilers and heating appliances. However, that doesn’t mean someone without official qualifications can’t also do the same things. You would just want to look for more evidence that they can, e.g. references, evidence they understand the relevant standards and rules they should be following etc.

We encourage all users of statistics, to ask themselves some questions to ensure the data are fit for their purposes. These include considering where the data has come from, why has it been collected, how well the data fits with the concept you are trying to measure, what checks have been carried out to assure the data, how can you access the data. Some more detail on things to consider are set out in our guidance on questions for data users.

What if the accreditation is removed?

Legally only we (the UK Statistics Authority) can remove the badge, i.e. the accreditation, from a set of statistics. We may decide on this course of action for a number of reasons. These could be related to concerns around the quality of the data sources used to produce the statistics, where user need is not being met or where substantial changes to the data sources and methods require us to conduct a review to ensure the quality of the data is such that they continue to be applicable for their intended use. The reason(s) should be included in the release and/or the announcement explaining why the accreditation has been removed.

What if some of the input statistics are not accredited?

Different sets of statistics often feed through into others. For example, migration data are used to inform population estimates and projections. Data from the labour force survey feed into productivity estimates. Producers of data and statistics should always quality-assure their data sources and be aware of any changes to them. The extent of quality assurance required and the weight placed on different data sources will vary depending on factors such as how much they affect the overall calculation, or whether there are any alternatives. We would expect this information to be communicated to users so they can understand the quality-assurance processes carried out and why the producer has decided that the data sources are fit for use. This is the case regardless of whether the source data are accredited or non-accredited.

How do I get my statistics accredited?

If you are a government department of official body that produces official statistics, and you have a set of statistics that you consider meet the standards of trustworthiness, quality and value in the Code then you can ask us to assess them. The benefits of doing so include:

An independent assessment of the processes, methods and outputs used to produce the statistics against the recognised standards of the Code.
Public demonstration of your organisation’s commitment to trustworthiness, quality and public value.

Your first step towards assessment is to talk with your Head of Profession for Statistics who can provide guidance and points to consider.

If you are producer of data, statistics and analysis which are not official statistics, whether inside government or beyond you can contact us to discuss voluntarily application of the Code. While this approach will not lead to accredited official statistics it is a public demonstration of your commitment to the standards of the Code, which many organisations find beneficial for their work.

How do I find out more?

further information about accredited official statistics: statisticsauthority.gov.uk/accredited-official-statistics
a range of additional guidance and tools to help understand what the Code it and how we apply it in practice: https://code.statisticsauthority.gov.uk/
questions for data users: https://code.statisticsauthority.gov.uk/questions-for-data-users/
top tips when using statistics infographic: https://code.statisticsauthority.gov.uk/for-communications-staff/
universal principles – for producers https://code.statisticsauthority.gov.uk/code-universal-principles/
guidance for producers on the OSR site: https://osr.statisticsauthority.gov.uk/guidance/
top tip sheet on using statistics for communications staff: https://code.statisticsauthority.gov.uk/for-communications-staff/

What is intelligent transparency and how you can help?

Statistics Regulator Siobhan Tuohy-Smith discusses what we mean by intelligent transparency and how you can be an advocate for intelligent transparency across government and official data, statistics and wider analysis.

So what is intelligent transparency?

Everyone, I think, has a fairly clear idea of what transparency means. It means being open or clear – getting the data or statistics out there. But what do we mean when we talk about intelligent transparency?

At its heart intelligent transparency is about proactively taking an open, clear and accessible approach to the release and use of data, statistics and wider analysis. As set out in our regulatory guidance on transparency, intelligent transparency is informed by three core principles: equality of access, enhancing understanding and analytical leadership. It’s about more than just getting the data out there. Intelligent transparency is about thinking about transparency from the outset of policy development, getting data and statistics out at the right time to support thinking and decisions on an issue, supporting the wider public need for information and presenting the data and statistics in a way that aids understanding and prevents misinterpretation. For example, the Welsh Government Chief Statistician posted a blog on understanding COVID-19 infection rates in Wales on 11 January 2022. This post went beyond just getting the data out there, by also aiding user understanding of the data to avoid misinterpretation.

Why is transparency important?

For me, transparency is a key part of what we do at the Office for Statistics Regulation (OSR). It’s a theme the runs throughout the Code of Practice for Statistics, from practice Q2.3 about transparency about the methods used, to V2.1 about ensuring free and equal access to regular and ad hoc official statistics, to principle T3 about orderly release, to name but a few.

Transparency is also a core part of ensuring data, statistics and wider analysis serve the public good. Only by seeing the numbers, and understanding where they came from, can we really understand what they mean and how to use them to best inform individual decisions and understanding of an issue. Individual decisions about where and when to buy a new house, mortgage decisions, and what school to send your child to. Or public understanding about COVID-19 infection rates or a new policy around climate change.

We highlighted the need for intelligent transparency as a key theme in our recent State of the Statistics System report and it continues to recur as a theme in our casework.

What can you do to support intelligent transparency?

In OSR, we continue to champion intelligent transparency and equal access to data, statistics and wider analysis. We:

Intervene on specific cases where we deem it necessary, guided by the UK Statistics Authority’s interventions policy.

Are building our evidence base, highlighting good examples and understanding more about barriers to transparency to help support those working across government to implement intelligent transparency. Today we have published some FAQs about intelligent transparency to help support this work.
Engage with analysts, policy-makers and the communications function across government, and interested parties outside of government to advocate intelligent transparency and develop networks committed to intelligent transparency.

But we recognise that this is not something we can do alone. We need your help!

So what can you do:

You can be an advocate for intelligent transparency across government and official data, statistics and wider analysis:

As a user of this data, you can continue to question what you see and ask yourself does it make sense? Do you know where it comes from? Is it being used appropriately?
If you are based in a department or a public body, you can champion intelligent transparency in your team, your department and your individual work. Build networks to promote our intelligent transparency guidance across all colleagues and senior leaders in your organisation. You can engage with users to understand what information it is they need to inform their work to inform the case for publishing it; get in touch with your Head of Profession or OSR if you experience issues publishing statistics, data or wider analysis of significant public value or interest

You can get in touch with us via regulation@statistics.gov.uk if you are interested in working with us on intelligent transparency. You can also keep up to date with our work via our newsletter.

You can raise concerns with us via regulation@statistics.gov.uk – our FAQs about how to raise an issue set out what to expect if you raise a concern with us.

Looking ahead

We will continue to champion intelligent transparency and with your help, together, we can help intelligent transparency become the default for all government data, statistics and wider analysis.

Why migration statistics matter

Like many out there I wake up every morning hoping that a way, that protects life, has been found to bring peace in Ukraine. As it says in one of my young daughter’s books, “The world’s already far too full of cuts and burns and bumps”^[1].

Unfortunately, the conflict continues and people from Ukraine are fleeing. On 10 March 2022, the UN Refugee Agency (UNHCR) estimates that just over 2.3 million people have fled Ukraine since 24 February 2022. Across the UK there has been an outpouring of public sympathy for Ukrainian people forced to flee. The Government has introduced some new visa routes for Ukrainians; and debate continues among the public, in the media and in Parliament about whether the UK is doing enough to help.

As with any crisis, lots of decisions will need to be made. Decisions by individuals, by governments and by agencies and by organisations helping to support people flee Ukraine and build new lives. Data and statistics are a key part of this decision-making process. For example, to inform local and national emergency response planning, the Office for National Statistics (ONS) has published new data about the number of Ukrainian nationals by local authority and the Home Office has published the number of people applying for these new Ukrainian visa routes.

Here at the Office for Statistics Regulation (OSR) I lead on OSR’s work on migration. At the heart of my role is ensuring that data and statistics serve the public good. What does this mean in this context? It means ensuring that the best possible data are available to inform decision-making. And it also means ensuring data are publicly available to help the public understand the impact of decisions made, for example to evaluate the impact of new visa routes for Ukrainians and the impact this has on the make-up of society in the UK.

Earlier this month, we published the first in a series of reports looking at how the Office for National Statistics (ONS) is transforming the way it measures international migration. These statistics provide estimates of how many people are flowing into and out of the country from across the world and what the impact is on the number of migrants in the UK. The previous methods, based on the International Passenger Survey (IPS), had limitations so it’s great to see new robust methods being developed in a credible way and in discussion with expert users. Our report welcomes the ambitious and collaborative approach being taken by the ONS to transform the way it measures international migration and recommends some ways ONS can build on this good work. I would like to thank all those we have engaged with us as part of this work for their openness and time. I look forward to continuing this work to ensure that the transformed migration statistics are trustworthy, high quality and support society’s needs for information.

More widely we also engage with other government bodies responsible for the production and publication of statistics and data on migration. For example, we regularly engage with the Home Office, which is responsible for publishing a wide range of statistics about migrants. We have recently written to the Home Office about the publication of data on migrants arriving in Small Boats. In our letter we welcomed the Department’s plans to regularly publish additional data about this topic.

At the OSR we want our work to have an impact. That means ensuring that data and statistics are there to inform decision-making across society, the public, private and third sectors and to help hold organisations to account. This is at the heart of what I do as a statistical regulator at the OSR and at the core of our migration work. I just hope in a small way this can have a positive impact on what is happening out there in the world today.

If you would like to feed into any of our work on migration statistics please get in touch with Siobhan Tuohy-Smith.

[1] Donaldson J & Scheffler A, 2010, Zog, Published in the UK by Alison Green Books.