Truths and Myths about the 2008 Election, Part II

Nov 5 '08

Much ink was spilled speculating about whether the polls were over-stating support for Obama because people couldn’t admit to pollsters that they wouldn’t vote for a black candidate. I can’t even be bothered to go find a bunch of links. Suffice it to say that when I searched for “Bradley effect” on Lexis Nexis, there were 215 stories in the past 3 months.

We did our part to question the importance of the Bradley Effect. See this post on Dan Hopkin’s research. See also Adam Berinsky’s threepart post.

So what happened yesterday? First of all, Obama’s share of the vote — 52% of the total votes cast — mirrored his standing in the polls at the end of the race (52% on Pollster). (The vote share data is obviously incomplete, but I can’t imagine it will change much.)

Second, if you look state-by-state, there is no evidence that he systematically under-performed viz. the polls. David Epstein of Columbia put together this graph over at Reflective Pundit:


He writes:

bq. The projections were more or less spot on. There’s a slight upward tilt to the actual results, meaning that Obama did better than he polled in the states he won, and worse than he polled in the states he lost. On average, for all states, he underperfomed his polling by about 0.8%.

bq. But we’re not necessarily that interested in whether he won New York by 25 or 26 points, or whether he lost Wyoming by 33 or 34 points. In the states where the last polls had Obama within 10% of McCain, in either direction, Obama actually outperformed his polling by about 0.5%.

bq. Of course, this doesn’t mean that some people didn’t lie to pollsters because of being embarrassed to admit they were voting against Obama. It means that, overall, the polls did a great job at estimating outcomes, and there’s no evidence at all of a massive divergence between polled results and actual outcomes.

To be sure, the Bradley Effect cannot be isolated simply by comparing the polls to the election returns. As Daron Shaw pointed out at a Brookings seminar a couple weeks ago, the election returns are also affected by turnout and other factors. That’s why Epstein is right to note that his results don’t mean people never lie to pollsters about their support for black candidates.

Nevertheless, this election does suggest that the Bradley Effect deserves far less emphasis than it has received. Hopefully this will be a lesson carried forward in future elections.