BBC ‘reality team’ fact-check Nicola Sturgeon’s launch speech and get it WRONG

A screenshot of a social media post

Description automatically generated
Not really

Once again thanks to Legerwood for alerting me to this misuse of data.

The graph below has been used before to illustrate the A&E performance of the 4 NHS regions in the UK and is re-used by the Reality Check Team. It seems to suggest little difference between that of NHS England and NHS Scotland but is incorrect.

A screenshot of a cell phone

Description automatically generated
Wrong

The team reports:

The first minister also said: “We have the best performing accident and emergency services anywhere in the United Kingdom.” Health is a devolved power, and each nation expects 95% of patients to be treated or admitted in four hours. Nicola Sturgeon is right to say that performance against this target was better in Scotland than in the rest of the UK in 2018-19 – when 91.2% of patients were treated or admitted in that time – but Scotland still missed its target. The figure compares with 88% in England, 80% in Wales and 69.9% Northern Ireland.

https://www.bbc.co.uk/news/amp/50348521

Leaving aside the unnecessary carping about devolved powers and missing the target, the FM was simply correct in her claim, but the NHS England performance was in fact much lower:

‘78.9% of patients were seen within 4 hours in type 1 A&E departments compared to 78.8% in Jun 2019 and 83.3% for the same month last year.’

Click to access Statistical-commentary-July-2019-ntSgq.pdf

The writers make an astonishing, beginner’s error in the use of statistics, with the effect of exaggerating NHS England’s A&E performance and reducing the gap with that of NHS Scotland. The error is simple. They mistakenly use the performance figures for ‘All’ A&E departments when they should only use those for ‘Type 1’ departments in England:

Type 1 A&E department: a consultant-led 24-hour service with full resuscitation facilities and designated accommodation for A&E patients. ‘All’ A&E types, include Minor Injury Units and Walk-in Centres.

https://www.england.nhs.uk/statistics/statistical-work-areas/ae-waiting-times-and-activity/ae-attendances-and-emergency-admissions-2017-18/

Only Type 1 data are comparable with those elsewhere in the UK and are reported discretely by NHS England for that purpose.

So, in 2018/19, 78.9% of patients were seen in 4 hours, in Type 1 NHS England departments, while in Scotland 91.2% were!

Thus A&E performance in NHS Scotland is 15.5% better than in NHS England and even NHS Wales performs better than it does.

7 thoughts on “BBC ‘reality team’ fact-check Nicola Sturgeon’s launch speech and get it WRONG

  1. Is this what the BBC is going to be doing throughout the election campaign? If so, I’m looking forward to their analysis of Boris Johnson’ speeches. And Jo Swinson’s will be an absolute treat.

    Like

  2. I’ve just looked at the latest OFFICIAL comparison of A&E figures for the 4 so-called Home Nations, for 2018-19. It was published on 12 Sept 2019 by NHS Digital, which is in England so no arguments from Unionists.
    See https://digital.nhs.uk/data-and-information/publications/statistical/hospital-accident–emergency-activity/2018-19

    The comparison is in a spreadsheet listed on that page. See my pinned tweet at @VoteYesSept for the summary of the data, which is excellent for Scotland. It’s clearly stated that the figures are directly comparable.

    The percentages for those waiting more than 12 hours are especially worth a mention – 2.0% for England and only 0.2% for Scotland. The other 2 nations are miles behind.

    Liked by 1 person

      1. Yes, I see that now John. Worth mentioning that my reference is for 2018-19, a year later, and the Scottish and English data for waits over 12 hours has not changed, so England is still 10 times worse.

        Also the Welsh figure increased to 5.5% from 4.8%, and Northern Ireland also up to 3.7% from 2.6%.

        Liked by 1 person

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.