IT was one of those rather delicious stories about a high powered study where painstaking effort and enormous brainpower are expended to produce what, on the face of it, is a blindingly obvious conclusion.
Investigating why the pollsters got it so badly wrong before the last election, the country's leading psephologist, John Curtice, left no stone unturned.
He compared the snap polls with broader annual surveys and he crunched numbers. Lots of numbers.
And at the end of an immensely detailed 20 page report, he said the pollsters got it wrong because they asked the wrong people.
Forget "shy Tories," "lazy Labourites" or a late, undetected swing to the Tories, the pollsters believed David Cameron and Ed Miliband were neck and neck on the eve of last May's election because the people they spoke to were unrepresentative of the population at large.
They spoke to too many Labour supporters who, for some reason, are easier to get hold of on the phone or by email, and too few Conservatives. They also spoke to too few young people, who are less likely to vote.
Fatally, they failed to correct the errors during the usual "weighting" process which is designed to turn the responses of the first 1000 or so people they contact into a more representative snapshot.
Old-fashioned, time-consuming (and expensive) random sampling cannot be beaten, Professor Curtice said.
The pollsters will have their say next week when the initial findings of an independent inquiry set up by the industry are made public. But it's unlikely there will be wholesale changes to their methods given the pressure they are under to take the political temperature in just a couple of days or so.
How accurate will the polls be on May 4, the day before the Holyrood election? We'll have to wait and see.
The question of why the polls got it wrong last year is probably not causing sleepless nights for most people.
But the wide margin of error (the Tories were nearly seven percentage points ahead in the end, far from neck and neck) raises a series of other questions that should concern voters.
Are we paying too much attention to the polls?
Are the polls shaping the way parties campaign and, by extension, public opinion rather than simply trying to reflect it?
Ed Miliband's former spin doctor Tom Baldwin complained bitterly about the influence of the polls on Newsnight this week.
At the last election, the polls raised the possibility of a minority Labour government propped up by the SNP, a scenario that was unpopular among large sections of voters in England. It was ruthlessly exploited by the Tories who produced posters of Ed Miliband in Alex Salmond's pocket.
The election became a "giant process story," said Mr Baldwin, making it hard for Labour to get a hearing when it tried to raise concerns over Tory plans for the NHS or tax credits.
George Foulkes, the Labour peer, agrees. His gripe with the pollsters goes back even further, to September 7, 2014, to be precise, when a YouGov poll put the Yes campaign in the lead for the first time in the independence referendum.
Lord Foulkes, who is campaigning for the polling industry to be regulated, believes that poll changed history, panicking the three main pro-UK parties into making their "vow" of extra devolution and, ultimately, producing the Smith Commission and new Scotland Bill.
Not everyone would agree all that was down to a single poll. But even if YouGov only nudged Messrs Cameron, Clegg and Miliband a little, the point is still made. It's worth thinking about with the referendum on Britain's EU membership hurtling into view.
Even the latest Holyrood polls have implications for how the parties campaign. You might think, with the SNP 30 points ahead, the polls don't matter. The pollsters might be a bit off target, one way or the other, but they can't be THAT wrong about the outcome. Yet the SNP will have to manage such a commanding lead or risk shedding list votes to other parties. Labour will have to find a way of making its policies the story rather than its collapse or its battle with the Tories for second place.
In the end, the media commission the polls and the media must take responsibility for presenting the findings. Perhaps we need to be a little more circumspect. Adjust our own weighting, if you like.
Why are you making commenting on The Herald only available to subscribers?
It should have been a safe space for informed debate, somewhere for readers to discuss issues around the biggest stories of the day, but all too often the below the line comments on most websites have become bogged down by off-topic discussions and abuse.
heraldscotland.com is tackling this problem by allowing only subscribers to comment.
We are doing this to improve the experience for our loyal readers and we believe it will reduce the ability of trolls and troublemakers, who occasionally find their way onto our site, to abuse our journalists and readers. We also hope it will help the comments section fulfil its promise as a part of Scotland's conversation with itself.
We are lucky at The Herald. We are read by an informed, educated readership who can add their knowledge and insights to our stories.
That is invaluable.
We are making the subscriber-only change to support our valued readers, who tell us they don't want the site cluttered up with irrelevant comments, untruths and abuse.
In the past, the journalist’s job was to collect and distribute information to the audience. Technology means that readers can shape a discussion. We look forward to hearing from you on heraldscotland.com
Comments & Moderation
Readers’ comments: You are personally liable for the content of any comments you upload to this website, so please act responsibly. We do not pre-moderate or monitor readers’ comments appearing on our websites, but we do post-moderate in response to complaints we receive or otherwise when a potential problem comes to our attention. You can make a complaint by using the ‘report this post’ link . We may then apply our discretion under the user terms to amend or delete comments.
Post moderation is undertaken full-time 9am-6pm on weekdays, and on a part-time basis outwith those hours.
Read the rules hereLast Updated:
Report this comment Cancel