Political Animal


August 01, 2012 5:12 PM Polling “Noise”

By Ed Kilgore

I’m guessing most readers already know that it’s generally a mistake to put a lot of stock in specific polls at this stage of the presidential contest. Poll trends often do matter—not necessarily in terms of predicting the final outcome, but certainly by way of illustrating how the dynamics of the contest are playing out. So today’s battery of highly favorable polls for the president from Ohio, Florida and Pennsylvania conducted by the formidable combo of Quinnipiac, CBS and the New York Times, when pondered on top of last week’s NBC/WSJ and Democracy Corps surveys, could indicate that something real is going on (particularly since both the DCorps and QPac polls use likely-voter screens, which typically give GOP candidates a small bonus).

Or at least that’s you might infer from the furious efforts by conservatives to discredit the QPac/CBS/NYT survey today. One line of attack focused on how participants say they voted in 2008. Aha! Much larger Obama margins than the actual results! Bad sample! Bad sample!

But as TNR’s Nate Cohn explains, this is a very common phenomenon; voters always disproportionately “remember” supporting the winner of past elections.

A similar argument is that the composition of the electorate in the poll shows just too many Democrats to be credible. But RCP’s Sean Trende, who is hardly in the tank for Obama, explodes that theory pretty decisively.

Any one poll can be an outlier, the result of random “noise” that does not reflect actual trends in public opinion. But the “noise” of those who want to dismiss any finding that doesn’t support their candidate is worse. As Cohn notes:

We’re at a peculiar point where many of the most highly regarded polls are showing a sizable advantage for the president, including NBC/WSJ, Democracy Corps, Pew Research, and Quinnipiac. And perhaps this is just the liberal media bias, but many pollsters showing a tighter race, including Rasmussen, Gallup, and JZ Analytics, have weathered an outsized share of criticism over the last few years.

New polls may soon come out creating a different impression of the race, and for that matter, a bad jobs report on Friday or some other external event could turn the arrows around for real. But in the mean time, data is data, and political gabbers should strongly fight the temptation to skew the data by perpetually claiming the data they don’t like is itself skewed.

Ed Kilgore is a contributing writer to the Washington Monthly. He is managing editor for The Democratic Strategist and a senior fellow at the Progressive Policy Institute. Find him on Twitter: @ed_kilgore.


  • Doug on August 01, 2012 7:47 PM:

    "...perhaps this is just the liberal media bias..." Nate Cohn cited by Ed Kilgore

    I hope Mr. Cohn didn't have to spit out too much blood after that tongue-in-cheek remark!

  • Zorro on August 01, 2012 7:58 PM:

    Lies, damned lies, and statistics...


  • low-tech cyclist on August 01, 2012 9:37 PM:

    Complaining about the polls, especially this early, is a sign of desperation.

    After all, it's three months until the election. The polls just are. Maybe they're good evidence, maybe they're not.

    But who benefits if the polls are more favorable to Party X, and less favorable to Party Y, than is actually the case?

    My answer would be, probably no one. Each side is going to keep on doing what it does, at this point in the game. We're still a ways from anyone changing their game plan over polls.

    But if anyone did benefit, it would be Party Y, the party that got underpolled. Because Party X would be the party with an illusory sense of confidence, just waiting for reality to pop its bubble. And Party Y would have reason to work harder than it really needs to, which should ultimately be more helpful to it than if the polls had been honest.

    People who bitch about the polls this early are people who are afraid the game's going against them, that their candidate is just as sucky a candidate as they'd feared, that he's going to screw up what should be a great opportunity, and there's nothing they can do about it.

    They don't want to admit that the game may be slipping away, so they blame the polls, because they can't blame their candidate until after it's all over.

  • dj spellchecka on August 02, 2012 8:11 AM:

    i took time to compare the party id sample sizes in the three states quinni polled vs the cnn 08 state exit polls and by that measure quinni oversampled independents, especially in pennsylvania...

  • afgsd on August 02, 2012 11:01 AM: