Pretty much since this yearâs exam results were released, weâve been reporting on an ongoing controversy over the way in which one of the papers was marked.
Teachers (including exam markers) accused the Scottish Qualifications Authority (SQA) of âmoving the goalpostsâ for Higher History by changing the marking standard after the exam had taken place.
The SQA insisted that this was false but then quietly opened an investigation into the matter. It was, however, carried out by a senior member of SQA staff and ended up being very, very late.
The report, which we were first told would be out by the end of September, was finally released on 6 November. In it, the SQA declared that there had been no problems with Higher History marking, that systems had worked as intended, and that the huge declines in pass rates and performance levels were just down to the pupils not being very good this year.
The Chief Executive said that the report was ârobust and rigorousâ and the SQA also pointed out that it had asked another exam board â the Welsh Joint Education Committee (WJEC) â to âprovide independent assurance that any conclusions reached were evidence-based and validâ.
The SQA tried very, very hard to make this the point at which we all âdraw a lineâ under the issue, but it didnât work â which is entirely unsurprising.
Instead, the criticism started almost immediately.
The Scottish Conservativesâ education spokesperson talked about a âwhitewashâ, while Labourâs Pam Duncan-Glancy was aghast that the SQA had âdecided to try and blame pupils and teachers for what went wrong here.â
SNP MSP, and former government minister, Fergus Ewing said that the report seemed to be âmore of an exercise in self-justification by the SQA than an honest attempt to answer legitimate and serious questions from children teachers and parents.â He also hit out at the lack of scrutiny to which quangos like the exam board tend to be subjected.
But worse â far worse â was to come because we also started getting the reaction from History teachers.
They called the outcome, and the SQAâs conduct, âa disgraceâ and a âgut punchâ that had left teachers âconfused and demoralisedâ. One Faculty Head was absolutely explicit that they would now seek to guide students away from taking Higher History and encourage them to instead consider subjects like Modern Studies, Geography and Politics, adding: âThose in charge of assessment have effectively destroyed the subject.â
A couple of teachers wrote a bit more extensively for us, laying out in considerable and damning detail their lack of faith in both the investigation that had been carried out and the SQA itself.
And it didnât stop there, because questions were also soon being asked about the actual methodology behind the SQAâs investigation.
The Herald discovered that, during the course of the review, the only people interviewed were those with links to the SQA â specifically, the âsenior appointeesâ whose work was, we all thought, supposed to be the very thing being examined.
We also contacted the WJEC, who confirmed that the person providing the âindependentâ oversight of the investigation had only spoken to two people: both of them senior SQA officials.
When challenged about all of this in parliament, First Minister John Swinney seemed determined, even desperate, to back the SQA â something that a number of people have told me felt an awful lot like what happened back in 2020, when he spent a week trying to defend the now-infamous exam algorithm that suppressed the grades of the pupils from the poorest areas in Scotland. He even went so far as to claim that a process of âpeer reviewâ had taken place.
But had it?
One of the things we tried to clarify was what, exactly, the WJEC was endorsing, and what sort of processes had been followed as part of that work. We laid out the concerns that the review only involved interviews with SQA appointees, and explicitly asked if the endorsement they had offered also extended to this aspect of the methodology.
They told us that âthe analysis supports the reportâs conclusionsâ but refused to comment on the methodology or scope of the investigation. Those questions, they said, would have to be directed to the SQA, which says it stands by the work that was carried out and believes that it is robust and credible.
An SQA spokesperson said: âThe Executive Director of Qualifications and Assessment at WJEC, an expert in standard setting in the context of national examinations, provided independent, external scrutiny and challenge of the review, including the evidence, conclusions and wider reflections. We provided Mr Harry [Richard Harry, WJEC executive director of qualifications and assessment] with whatever additional information he asked for to be able to undertake his work and he has publicly acknowledged the review teamâs candour and openness to challenge through this process.â
The matter has now been taken up in parliament, with John Swinney told he has âquestions to answerâ and should âcome cleanâ, and the education secretary under pressure to make a statement about the latest stage of the âsagaâ.
The big question is this: is it reasonable to call an investigation ârobust and rigorousâ when the person leading it (who works for the same organisation as the one accused of 'moving the goalposts') only interviewed people with something to lose from a negative outcome â specifically the marking team who would have been responsible for the conduct that had been alleged?
And, on a related note, is âpeer reviewâ an accurate description for a process that was not anonymous and that, so far as we know based on the public statements of those involved, did not involve full consideration of the methodology and processes that generated the evidence behind the report's conclusions?
So far, the answers to those questions certainly donât seem to be resoundingly affirmative.
Got questions, queries, stories or tips for our education writers? Send us an email.
|