Ed Humpherson response to Siobhan Carey: Temporary suspension of National Statistics designation for Northern Ireland tourism statistics

Dear Siobhan

Northern Ireland Tourism Statistics

Thank you for your letter of 29 September 2020 regarding Northern Ireland tourism statistics. I welcome the publication of your 2019 Northern Ireland Annual Tourism National Statistics later this month, following the suspension of this output earlier in the year due to the data from the Household Travel Survey conducted by the Central Statistics Office in the Republic of Ireland being unavailable. I am pleased to hear that these data are now available and that you are sufficiently reassured that the quality meets the high standards required for National Statistics.

Given the ongoing disruption to the collection of tourism statistics in Northern Ireland caused by COVID-19, I support your decision to temporarily remove National Statistics designation from statistics published for Quarter 1 2020 onwards. Statistics on tourism in Northern Ireland are highly valued by users, so I am pleased that you will continue to publish statistics from other available data, such as passenger flow at airports and occupancy in hotels, as well as exploring other data sources which may provide further insights for users.

We will continue to engage with your statisticians, via our Travel, Transport and Tourism team, and look forward to considering the restoration of National Statistics status once data collection has resumed and you are assured the statistics can meet the standards expected by the Code of Practice for Statistics.

Yours sincerely

 

Ed Humpherson

Director General for Regulation

 

Related Links

Siobhan Carey to Ed Humpherson: Temporary suspension of National Statistics designation for Northern Ireland tourism statistics

Request to temporarily suspend Northern Ireland travel and tourism statistics

Temporary suspension of Northern Ireland travel and tourism statistics

Siobhan Carey to Ed Humpherson: Temporary suspension of National Statistics designation for Northern Ireland tourism statistics

Dear Ed

This note follows on from our correspondence in April regarding the temporary suspension of the Northern Ireland Tourism Statistics. As you may recall, the suspension was due to the unavailability of the Central Statistics Office’s (CSO’s) Household Travel Survey data which provides an estimate of overnight trips to NI by visitors from the Republic of Ireland (RoI). As agreed at that time, we published official statistics on overnight trips to NI (excluding RoI visitors)for quarters 2 and 3 2019 in June 2020 and are now working towards the publication of the 2019 Northern Ireland Annual Tourism National Statistics during October 2020 –the latter will include overnight visits to NI by RoI residents.By way of background, CSO has advised that they will be publishing their 2019 annual statistics on 30th September including overnight visits to NI by RoI residents.

We have spoken to CSO and are reassured that the quality of the statistics are comparable to the historic series. We had already discussed and agreed with our key users that we would defer publishing our annual statistics until the CSO data were available as this would avoid publishing two sets of data which could potentially cause confusion. Our key users were content with this approach.

The publication was suspended following the publication of quarter 1 2019 tourism statistics and the production of the October release will allow us to complete the time series. All quarterly statistics will be contained within this release.

As anticipated, COVID-19 has caused disruption to the collection of tourism statistics in Northern Ireland. We propose that we publish data for Quarter 1 2020 up to the date that face to face data collection stopped (17th March 2020). We suggest that this should not have National Statistics status. We will continue to publish passenger flow at airports (Official Statistics) and occupancy in hotels (National Statistics) and other accommodation establishments (Official Statistics) for the period they are open. We are continuing to explore other data sources that can give our users an indication of tourism in Northern Ireland during 2020.

Yours sincerely,

SIOBHAN CAREY,

CBE Registrar General for Northern Ireland & Chief Executive NISRA

 

Related Links

Ed Humpherson response to Siobhan Carey: Temporary suspension of National Statistics designation for Northern Ireland tourism statistics

Request to temporarily suspend Northern Ireland travel and tourism statistics

Temporary suspension of Northern Ireland travel and tourism statistics

Ed Humpherson to David Marshall (NISRA): Assessment of 2021 Censuses in the UK

Dear David

Assessment of 2021 Censuses in the UK –  Northern Ireland Statistics and Research Agency (NISRA) Response to Preliminary Findings

We have reviewed the actions that NISRA has taken to address the findings in Assessment Report 345: 2021 Censuses in the UK – Preliminary Findings. These findings aim to build on the existing work being undertaken by Census offices, providing further direction and focus on pre-existing plans.

The Office for Statistics Regulation’s (OSR’s) advice on the National Statistics designation will be based on the trustworthiness, quality and value secured by Census offices. That advice will take account of the actions taken to address findings or requirements from OSR as part of this assessment process. While many of the Phase 1 findings can only be fully actioned or addressed over longer timescales, it is my view that NISRA has responded well to the assessment findings so far. I recognise the ongoing commitment of NISRA’s Census team to enhance the public value, quality and trustworthiness of the data and statistics from Northern Ireland’s Census – particularly in light of the challenges and changes in ways of working that have had to be managed given the COVID-19 pandemic.

Since we published our assessment report in October 2019, my team has engaged with various members of your staff working on the Census to understand the improvements you have made since then. I appreciate the team’s willingness to engage with the assessment team and the work that has gone into making further improvements. In evaluating how NISRA has responded to our findings we have taken account of published materials from NISRA including the evidence report NISRA response to OSR findings from Phase 1 of Census 2021 National Statistics assessment, alongside information gathered through meetings and workshops held with your team. I consider that some actions taken by NISRA are of note.

  • In considering our findings, NISRA has actively improved its website and has added more content for users. In particular, the steps the Census team has taken to implement a clearer structure have been successful and the structure now lends itself to accommodate new and future published content.
  • My team held a data sources session with NISRA’s Census team in March 2020, and in this session the team clearly demonstrated a strong understanding of the strengths and limitations of each of its data sources, and of the quality assurance processes for each source. My assessment team welcomes the openness of the Census team in NISRA to discuss and answer our questions on their use of administrative data.

We consider that further action is still needed in some areas identified for improvement in our assessment report – this is partly due to changing circumstances such as the impacts on programme delivery given the pandemic. For example, while the assessment team felt reassured by NISRA’s approaches to the use of administrative data through the session in March, currently there is little information available in the public domain. We also note that NISRA is still refining and developing a quality strategy and its methods following its Census rehearsal. It is important that NISRA provide users and stakeholders with information on its use of administrative data, Census methods and on its quality assurance arrangements. NISRA should consider what existing materials or provisional information could be made public on its plans and processes to ensure Northern Ireland’s Census data will be of sufficient quality. This information can be built on as your research and understanding continues to develop.

In the assessment report we highlighted the need to be clear to users on the impacts of country-specific decision making on UK Census data and statistics. Due to the decision by Scottish Ministers to delay the Census in Scotland, it is even more important NISRA work with the other Census offices to explain the impacts of this to UK Census data users.

From speaking with your team, it is clear NISRA recognises the importance of communicating to Northern Ireland Census data users about delivering its Census in 2021 and on its scheduled plans for Census outputs. Users should be kept up to date and be provided with further detail as more information on the timing and content of statistical outputs becomes available.

We have included more detail about our judgement in an annex (see PDF download) to this letter. I, or my team, would be happy to talk you or your colleagues through any aspects of this letter or Code compliance more generally.

I am copying this letter to Sir Ian Diamond, National Statistician and Siobhan Carey, Chief Executive and Registrar General for Northern Ireland.

Yours sincerely
Ed Humpherson
Director General for Regulation

Mark Pont to Siobhan Carey: Statistics from the Northern Ireland Safe Community Survey

Dear Siobhan

STATISTICS FROM THE NORTHERN IRELAND SAFE COMMUNITY SURVEY (NISCS)

We have completed our review of the compliance of statistics from the Northern Ireland Safe Community Survey, produced by the Department of Justice (DoJ), with the Code of Practice for Statistics. This was the final part of our three-part review, which began in May 2018. This letter sets out our key findings from the review. I am pleased to confirm the statistics from the survey should continue to be designated as National Statistics: in this letter we have highlighted several areas for improvement, which will ensure the statistics continue to meet the highest standards of the Code.

As we completed our review, the COVID-19 pandemic meant the Safe Community Survey, which was a face-to-face survey, had to pause while arrangements were made to collect data for the 2020/21 statistics by phone instead. We support this approach, which will ensure the safety of those collecting data for, or contributing data to, the statistics. We look forward to seeing how your plans develop for the 2020/21 statistics and encourage the team to keep users of the statistics informed about the changes.

The rest of this letter briefly summarises our approach to the recent review and our findings, which will apply to the 2019/20 statistics. We illustrate areas where progress has been made since the first part of the review, as well as areas where we consider improvements should still be made to enhance the value of the statistics.

Our review of these statistics has been in three parts; this part focusses on the presentation and reporting of the statistics. As part of our research, we spoke to a range of users of the statistics to understand the impact of recent changes to the statistical bulletins and the extent to which users feel that their needs are being met.

In each part of our review, we considered the trustworthiness, quality and value – all of which are fundamental to supporting public confidence in statistics and, together, form the basis of the Code – of the survey and the statistics. Taken together, our findings across the review are as follows.

 

Trustworthiness

Ensuring sufficient resource

The team has taken on two new statisticians during the course of our review, allowing improvements to the current statistics and to address the improvements suggested in the earlier phases of our work. A new member of staff has now joined the statistics team and the team has published a Future Programme of Work, which provides a high-level outline of developments that the team aims to address in relation to the survey and statistics. These steps demonstrate DoJ’s prioritisation of, and commitment to, the statistics, while offering greater transparency about upcoming changes to the statistics for users. Users we spoke to said that engagement on the Future Work Programme had been good and they were happy with the information around the proposed statistical priorities. We note that dates for different pieces work on the Future Programme are still to be confirmed. In order to enhance trustworthiness, the team should include more-explicit timescales in the Programme and we encourage DoJ and NISRA to continue to ensure enough resources in the team to fulfil this work. Including this information will also allow users of the statistics to more easily engage with DoJ on the order and prioritisation of developments.

 

Quality

Improving data sources

Throughout this review, the statistics team has demonstrated ongoing commitment to improving the quality of the statistics from the Safe Community Survey. In general, the information about quality provided alongside the survey and statistics in the Quality Report and User Guide is extensive, and provides helpful information that allows users to understand the strengths and limitations of the data and statistics.

The survey sample size has increased from 2,000 to 3,500 from April 2018. This was achieved through additional financial investment in the survey, in response to feedback that statistics from the survey were no longer adequate to track progress against outcomes in the Northern Ireland Executive’s Programme for Government Framework. Given the change in the sample size, it was good to see that the team had done some work to ensure the integrity of the long-term crime trend estimates, and included confidence intervals around published survey estimates, so that users can more easily understand the quality of the statistics.

Regional Data

Despite the increase in survey sample size since 2018, some users of the statistics we spoke to still feel that estimates below country and population level need to be more robust. For example, when looking at disaggregated data for different counties in NI, users feel they are unable to make evidenced-based decisions because the confidence intervals around the estimates are so large. This issue arises because the sample sizes for geographic areas and demographic groups below country and population level respectively are relatively small. The team is aware of the user demand for robust statistics at a more disaggregated level, especially for analysis at Local Government District level, and is currently considering how this might be met. In addition to considering how the user need at low geographic levels can be met, the statistics team should consider how it can most effectively explain uncertainty around the survey estimates, so that users understand why the confidence intervals around disaggregated data are variable and can be large. The team should also be clear about how the statistics can and cannot be used.

Impact of COVID-19

It is good that the statistics team was able to move from face-to-face survey data collection to phone data collection. The team has been working well with policy colleagues to discuss changes to the questions and informing users of the changes happening to the survey on its website. We understand that there are some areas that will not be able to be covered in a phone survey. However, it is good know that important topics have been retained, such as:

  • experience of crime
  • perceptions of crime and anti-social behaviour
  • confidence in the police and police accountability arrangements

It is also good that the team has contacted both ONS and Scottish Government to discuss their experiences of changing to a phone survey design, this type of cross-nation engagement will further the improvement of the statistics, particularly during the current challenges. The team now has quarterly meetings with statisticians from the ONS and the Scottish Government, which will enable shared learning and provide an opportunity to discuss current issues and future development.

The change of data collection method will have an impact on the type of data that can be collected and the questions that can be asked. As this work develops, we encourage the team to be clear to users in advance about the impact this may have on future statistics, for example on trends in domestic violence, which could be difficult to collect by phone.

Value

Continued relevance to users

We have been impressed by the statistics team’s collaborative and user-focused approach to developing these statistics. This approach continues to help the statistics team through the current difficulties; the communication between the team, the Scottish Government and ONS will ensure the continued value of the statistics despite a more reduced output in 2020/21.

In 2018, the statistics team completed a consultation process and had extensive dialogue with users and potential users in government about their needs from, and proposed changes to, the survey and statistics. The team took account of these needs, by accommodating demand from policy teams to collect data that reflect important issues not previously covered by the survey. Several of the users we spoke to had been able to input into the questions asked in the survey. To maintain an understanding of the use and potential use of the statistics and data, the team now holds a biannual working group meeting with key policy and statistical stakeholders. In addition, the team has recently completed a branch-wide customer survey which sought comments on individual branch publications including NISCS reports. We look forward to seeing the results of this survey. Having this dialogue will help ensure that the maximum value is achieved from the survey and the statistics.

One of the key messages from the DoJ consultation in 2018 was that the presentation and reporting of the statistics needed to be improved. In response, the statistics team has introduced a new layout for its statistical bulletins, with changes to the content and presentation of the data and supporting narrative. Many of the users we spoke to now find the statistics to be useful and the narrative easy to follow: in particular, the use of annotations on charts has proved effective, as this helps users to better understand trends in the data.

Greater insight for users

As part of the improvements to the statistical bulletins, the inclusion of tables of police recorded crime data alongside the survey data in the Experience of crime publication gives users a fuller picture of crime in Northern Ireland. Our user engagement highlighted that, while the addition of these data is welcomed, there is still more that could be done to maximise the insight users get from them: the statistics team should include commentary that highlights which source of data is best for answering the different questions users might have about different crime types, for example. The crime statistics produced by ONS do this well and provide a helpful example. We anticipate the positive relationship the team already has with statisticians in ONS will facilitate greater insights.

Among the planned developments to the statistics, an issue worth highlighting is the clear demand to understand child victimisation. It has been positive to see questions being included in the Young Persons’ Behaviour and Attitudes Survey as part of an effort to meet this need, it also good that the Northern Ireland Safe Community Survey: Assessment of the Feasibility to Include Children Aged 10 to 15 and Communal Establishments was published on 17 April 2020. To maintain transparency, we encourage the team to continue to communicate its plans effectively to users in this area. This is an important issue and it is vital that the team is transparent with users about whether and when the data and statistics could be improved, remaining clear about the possible effects of moving to a phone survey.

I would like to thank your team for working closely with us throughout the review process and for its commitment to improving these statistics. Our Crime and Security team will continue to liaise with you and your team and, if you wish to discuss any aspects of this letter, we are happy to do so. I look forward to seeing the trustworthiness, quality and value of the statistics continue to improve. I am copying this letter to Ruth Fulton, Head of NISRA Statistical Support Branch; and to Joan Ritchie, the crime statistician at the Department of Justice.

Yours sincerely

 

Mark Pont

Assessment Programme Lead

 

Related Links

Compliance check of Northern Ireland Safe Community Survey

Siobhan Carey reply to NISCS compliance check

Northern Ireland Safe Communities Survey

Mark Pont to Siobhan Carey: Northern Ireland Multiple Deprivation Measure

Dear Siobhan 

 NORTHERN IRELAND MULTIPLE DEPRIVATION MEASURE  

I am writing to you following our review of the indices of deprivation statistics produced by the Ministry of Housing, Communities and Local Government (MHCLG), the Scottish Government and the Welsh Government against the Code of Practice for StatisticsThe statistics were reviewed against the three pillars of the Code: trustworthiness, quality and value.  

As you are aware, our review did not cover Northern Ireland as the Northern Ireland Multiple Deprivation Measure (NIMDM) is not produced to the same time scale as the other indices. However, there may be findings from our review which are applicable to the future development of NIMDM. 

If you have any questions about our findings, our Labour Market and Welfare team is happy to engage with you and your team. 

I am copying this letter to Dr Tracy PowerDirector of Analysis for NISRA and to Ruth Fulton, Head of Statistical Support Branch at NISRA. 

 Yours sincerely 

 

Mark Pont 

Assessment Programme Lead  

 

Related Links

Mark Pont to Sandra Tudor: English Indices of Deprivation 2019 statistics

Mark Pont to Roger Halliday: Scottish Index of Multiple Deprivation 2020 statistics

Mark Pont to Glyn Jones: Welsh Index of Multiple Deprivation 2019 statistics

Response from Siobhan Carey to Ed Humpherson: Devolved public finance statistics-Northern Ireland

OSR Review of the Public Value of Devolved Public Finance statistics

Dear Ed

Thank you for your correspondence regarding the constructive review that the OSR recently completed regarding the “Public Value of Devolved Public Finance statistics”. I apologise that a range of other competing priorities have prevented me from responding until now.

As you may be aware, the level of interest in Northern Ireland public finances has grown quite considerably over the course of the past year. In addition, the return of the NI Executive along with its associated spending priorities (including those arising from the global coronavirus pandemic) will no doubt heighten interest in, and scrutiny of, public finances and, in particular, the discharge of the NI Executive’s budget.

While the precise remit, objectives and workings of the new independent Fiscal Council committed through the ‘New Decade New Approach’ agreement have still to be formulated, it will provide a fresh and renewed impetus for such scrutiny and the delivery of greater insights and compelling narratives from the data as the review recommends.

The work that we do in the peer review process of the Country and Region Public Sector Finance Statistics publication is undertaken in conjunction with economist colleagues in the Department of Finance. With their support, I am happy to work collaboratively with the ONS and the other Devolved Administrations to develop more engaging messages and better ways of presenting these data. Clearly it will be important that these are commensurate with the needs of users in Northern Ireland and further afield.

I also support the need for better quality country and region public sector investment statistics including estimates for the value of assets and liabilities, which will be beneficial in our supply & use tables work in terms of ensuring more robust data on the investment side. It would also be useful to have better information on capital formation statistics. Again, I am more than content to work with colleagues across the Devolved Administrations and at the ONS in developing these statistics over the medium term.

In closing, I very much welcome the findings from your review and am committed to working collaboratively with the various stakeholders within the Department of Finance, the NI Executive, at the ONS and in the other Devolved Administrations, to address the recommendations that have been made.

Yours sincerely,

SIOBHAN CAREY, CBE
Registrar General for Northern Ireland & Chief Executive NISRA

 

Related links:

The Public Value of Devolved Public Finance Statistics

Letter from Ed Humpherson to Siobhan Carey

Letter from Dr Eugene Mooney regarding statistical information relating to COVID-19 in Northern Ireland

Dear Ed,

RE:    Publication of Daily COVID-19 related statistics via a Public facing Dashboard

I am writing to you to set out our proposed plans for the orderly release of COVID19 statistics by the Department of Health Northern Ireland into the public domain.

It would be my intention to release daily information in the form of a public facing dashboard on COVID19 beginning Friday 1st of May 2020 at 2.00pm each day. I recognise that this would be a departure from the normal release practice of the standard publication time of 9.30am but would suggest that by moving to this release time we will be able to provide the latest position on a range of statistics that are of interest to our users. It will, for example, allow us to present a range of information reflecting the position in the preceding 24 hours as of 9.00am each day. It would be my intention to apply the normal pre-release practice.

Once the dashboard is ‘up and running’ it would be my intention to add further content both to provide a more fuller picture of how the virus continues to effect citizens in Northern Ireland and to reflect user feedback. In doing so I will of course pre-announce any changes to the dashboard content so that users are aware of our plans in advance.

I trust that this meets with your approval.

Yours sincerely,

Dr Eugene Mooney
Senior Statistician, NISRA

Related links:

Letter from Ed Humpherson

Exceptional pre-release access granted for NISRA weekly deaths

Dear Ed,

You will be aware of the recent publicity surrounding deaths due to COVID-19 and whether the published daily figures for the UK, and Northern Ireland, cover just deaths in hospital or also include deaths in care homes. You will also be aware that ONS published deaths split by location for the week ending 3rd April last Tuesday and NISRA plan to publish deaths split by location for the week ending 10th April this morning at 9.30am.

Not only is there high public interest in this information but there is also high potential for misunderstanding (due to the complexity of the definitions for both the weekly deaths published by NISRA and daily figures provided by the PHA). To avoid the risk of misinterpretation, NISRA has taken the decision to brief journalists in advance of the release (via interactive video conferencing) with the data being released to these journalists at 9.20am.

We have applied the public interest test outlined in section (5)(2)(b) of the Pre-Release Access to Official Statistics Order (NI) (the public benefit likely to result from such access (including the timing of such access) significantly outweighs the detriment to public trust in official statistics likely to result from such access) and concluded that in the current circumstances the criterion is met. In particular, we consider that the Value of the statistics will be significantly enhanced at the expense of only a small risk of reduced Trustworthiness.

A list of the organisations represented by the journalists who attended the briefing (see Annex A) has been published as part of the Pre-release Access list, along with the rationale for granting such access.

Yours sincerely,
SIOBHAN CAREY, CBE

ANNEX A: ORGANISATIONS GRANTED EXCEPTIONAL PRE-RELEASE ACCESS

  • BBC
  • UTV
  • Belfast Telegraph
  • Daily Mirror
  • Irish Times
  • Slugger O’Toole
  • Financial Times
  • Reuters
  • Downtown Cool FM
  • Q Radio
  • JPI media
  • Impartial Reporter
  • Belfast Media Group
  • Derry News
  • Causeway Coast and Glens News

Request to temporarily suspend Northern Ireland travel and tourism statistics

Dear Ed,

As you will be aware, one of the sources of data used in the production of NISRA’s Northern Ireland Tourism Statistics is unavailable. The source in question is “The
Household Travel Survey (HTS)” conducted by Central Statistics Office (CSO), which provides an estimate of overnight trips to Northern Ireland by visitors from the
Republic of Ireland (ROI). In the most recent annual and quarterly publications, this estimate accounted for approximately 12% of all overnight trips and 11% of the
overall tourism spend.

CSO has suspended the HTS due to underlying data quality issues (see Annex 1 for further detail), which they are currently in the process of addressing. It was expected that it be will summer 2020 before they would be in a position to determine if the matter has been satisfactorily resolved, thus facilitating the release of the information to NISRA. However, the COVID-19 global pandemic has meant that CSO surveys have been suspended which ultimately means that these indicative timings will be pushed back further. The impact of this is that NISRA is currently unable to produce and publish its National Statistics publications (Northern Ireland annual tourism statistics).

In view of this and as an interim measure, I propose to suspend the publication of the National Statistics until the ROI data become available and move to publish the tourism information that we have in appropriately tailored and caveated releases (information relating to quarters 2 and 3 of 2019 will constitute the first release).

These will focus on the place of origin of visitors (clearly differentiating each market), highlight the information that is missing and include appropriate data coverage and quality guidance for users. The information in the new format releases will account for the vast majority of overnight trips in NI and will include domestic tourism within NI, visitors from GB and visitors from overseas areas.

I consider that this approach is in the public interest and provides the best compromise until normal business can resume. While it has been discussed and
agreed with key stakeholders including tourism policy leads, all of whom are content, I would welcome your views on this proposed way forward.

In addition to the above, the COVID-19 global pandemic will undoubtedly continue to cause major disruption to the tourism sector for the foreseeable future. In
accordance with government guidance, I have taken the decision to temporarily suspend NISRA’s face-to-face survey field operations resulting in the cessation of
interviews conducted through the NI Passenger Survey. Clearly this will have a further impact on NISRA’s NI Tourism Statistics, which will also need to be managed.

Yours sincerely

SIOBHAN CAREY, CBE
Registrar General for Northern Ireland & Chief Executive NISRA

 

Related Links:

Ed Humpherson to Siobhan Carey (March 2020)

Temporary suspension of Northern Ireland travel and tourism statistics

Dear Siobhan,

Thank you for your letter of 2 April 2020 regarding Northern Ireland tourism statistics. Given the ongoing data quality issues with the Household Travel Survey (HTS) conducted by the Central Statistics Office in the Republic of Ireland, I support your decision to temporarily suspend the National Statistics publications which rely on the HTS as one of the main data sources. The Office for Statistics Regulation recognises that there is a strong user need for figures on overnight trips to Northern Ireland. Therefore, I am pleased that you will continue to publish your remaining tourism data which is unaffected by this issue as official statistics in order to provide users with as much information as possible.

We will continue to engage with your team, via our Travel, Transport and Tourism domain, regarding the pre-existing data quality issue with the HTS and the longer-term impact of Covid-19 on Northern Ireland tourism statistics.

Yours sincerely
Ed Humpherson
Director General for Regulation

Related Links:

Siobhan Carey to Ed Humpherson (March 2020)