Did Race Cost Obama in 2008?

Erik recently blogged about a new paper (pdf) by Seth Stephens-Davidowitz that used Google searches to measure racial prejudice in American media markets and found this:

The estimates imply that racial animus in the United States cost Obama three to five percentage points in the national popular vote in the 2008 election.

The Google methodology is a viable way to grapple with people’s unwillingness to reveal racial prejudice in polls and surveys.  Of course, one can criticize it—as Rebecca Greenfield does here—but an even better strategy is simply to see if Stephens-Davidowitz’s results are confirmed by recently published research using other kinds of measures.  Here’s an example, from a recent paper in Political Psychology by political scientist Brian Schaffner (ungated; see also the rest of the issue, also ungated thanks to Wiley-Blackwell publishers):

In this paper, I introduce a relatively unobtrusive measure of racial salience to examine whether these initial interpretations are correct. I find that when race was a more salient factor for White voters, they were substantially less likely to vote for Obama and were more likely to think that Obama was focusing attention on African Americans during the campaign. I estimate that the salience of race for some Whites may have cost Obama as much as 3% of the White vote. Thus, this paper indicates that even in Obama’s historic 2008 campaign, African American candidates continue to face barriers to winning White support.

Emphasis mine.  The effect is similar in size to what Stephens-Davidowitz find.  Schaffner’s measure began with this prompt:

If you had to vote in an election but did not know any of the candidates competing, which pieces of information would be most useful for helping you decide who to vote for?

Then respondents simply asked people to rank several factors, including the candidates’ race, in terms of their usefulness.  Schaffner finds that the higher people who ranked race as more useful were less likely to report voting for Obama—a relationship that was most evident among racial conservatives (in this study, opponents of affirmative action).

In fact, the effects in these studies are comparable to the effects in other studies that do rely on explicit measures of racial prejudice.  Although it is true that some people may be reluctant to reveal those sentiments in a survey interview, many people will.  So Lewis-Beck, Tien, and Nadeau estimate that racial prejudice cost Obama 5 percentage points.  Josh Pasek and co-authors arrive at the same estimate: 5 points.

However, a lot hinges on the relevant counterfactual.  Stephens-Davidowitz imagines that every media market has a level of racial prejudice equal to that of the least prejudiced market.  Pasek et al. study simulate the absence of both pro- and anti-black sentiments.

But another counterfactual is: what if we replaced Barack Obama with a white candidate—say, Hillary Clinton?  In this study by Simon Jackman and Lynn Vavreck, they find:

The Democrats would have won the 2008 election regardless of who they nominated, but the average Democratic party nominee from the last 16 years, and either of Edwards or Clinton, would have done better against McCain than Obama, although in Clinton’s case, not by much.

What is “by much”?  Half a point.  But Edwards would have done about 3 points better—an estimate commensurate with those above.

So contra my very preliminary back-of-the-envelope analysis a few months after the election, race may have cost Obama in 2008.  But the hypothetical Clinton vs. McCain race is important.  It’s not enough just to imagine a world without racism—whether measured with explicit questions, implicit questions, or Google searches.  It may be equally relevant to imagine a world without a black candidate.

UPDATE: See also the study by Benjamin Highton in the comments.

17 Responses to Did Race Cost Obama in 2008?

  1. Andrew Gelman December 1, 2011 at 10:11 pm #

    “Edwards would have done about 3 points better” . . . That statement is, I assume, conditional on his private life staying private?

  2. andrew long December 2, 2011 at 1:28 am #

    In fact, Schaffner estimates Obama would have lost only about 2% of the *total* vote share.
    From his conclusion: “Obama would have performed about 3 percentage points better among Whites under these conditions [“if no White voters found race to be salient”]. Given that exit polls estimated that Whites made up approximately three-fourths of all voters, performing 3 percentage points better among Whites would have translated into a gain of about 2% in Obama’s overall vote share.”

    That’s a potential difference of 1-4 points from Stephens-Davidowitz’ finding, and the lowest estimate of all the studies cited. So, do you still consider that sufficiently similar to the others?

    • John Sides December 2, 2011 at 9:11 am #

      Andrew: Given all the assumptions that go into these counterfactuals, any point estimate will have substantial uncertainty. So I don’t see the difference between 2 points or 3 points or 4 points as meaningful in the statistical sense.

      • andrew long December 2, 2011 at 11:34 am #

        ok thanks for the reply.

  3. Ben Highton December 2, 2011 at 12:40 pm #

    Here’s an article of mine that estimates the effect of white prejudice on white voting and then “removes” the prejudice effect to see what additional states Obama might have won, along with attempting to give a sense of the uncertainty about the prediction. I find that Obama probably would have won in a landslide: “Given the 365 electoral votes that Obama gained from the states he actually won, the predicted Obama electoral vote rose to 451 (365+86), with a 95% range of 400 to 499.”

  4. Anonymous At Work December 2, 2011 at 3:12 pm #

    Any indication how this would have translated down the ballot? Would the Democrats have had 61 Senate seats, or 2-3 more House seats as a result of Obama being “white” or nominating Edwards?

    • MNP December 2, 2011 at 8:53 pm #

      This is what I am most interested in.

  5. Woodrow December 2, 2011 at 3:48 pm #

    To go further: I would like to suggest, based on the polling of 2007-08 and on his perceived ideological moderation, that John McCain was a pretty darn good candidate.

    Imagine a scandal-free John Edwards vs. a generic Republican, right after the financial crisis. I have three words for you: FIFTY STATE SWEEP!

  6. Vladimir December 2, 2011 at 5:51 pm #

    But, are these researches taking into account the higher turn out and share of the black vote that Obama got?

    • Ray December 2, 2011 at 9:31 pm #

      They’re specifically talking about the White vote. A lot of Obama’s surge in the black vote had to do with the President’s campaign getting more Black voters to the polls and voting. There wasn’t a sudden shift of Black Republicans leaving to vote for a Democrat but there was a surge in the number of Black people voting for President.

      A lot of that was due to the campaigns early voter registration drives targeting mainly the untapped markets of young voters, minorities, and the elderly.

  7. houston_wood December 2, 2011 at 9:32 pm #

    I haven’t looked at all of this research in detail, but the aggregate analyses (Highton and Stephens-Davidowitz) seem to suffer from the problem of an endogeneity/omitted variable, namely campaign spending/mobilization. If the Obama campaign believed these racially prejudiced states to be out of reach (for a variety of reasons, but one of them presumably because of the problem of race), then they would not put a lot of effort into getting white votes in those states. I suppose I buy that he is getting marginally dinged in many of these red red red states for reasons of race, but what happens if these authors limit the analysis to states where there was a decent chance for Obama? Say, anywhere above 35% eventual nonblack support for Obama? Or even directly controlling for campaign spending or mobilization. I just cannot tell which states are driving the findings here, and thus whether this “matters” or whether it doesn’t really matter (the effects are mostly in places where it didn’t matter if he won more white votes).

    • shaun May 6, 2012 at 5:16 am #

      i would say “in those areas of those states”. In Georgia, for example, whites in atlanta and the metro area have little to do with those in, say, the countryside around cartersville or rome.

  8. Scott December 3, 2011 at 10:13 am #

    Do any of these analyses take into account the flip-side of the coin? I believe Tesler and Sears argue that racial liberals were MORE likely to vote for Obama than they would have been if he were white. I have no idea what the prevalence or magnitude of this effect might be, but it seems important to consider.

  9. Joe December 4, 2011 at 10:17 am #

    I agree with Scott. It doesn’t appear any of the studies ask how much Obama’s race helped him win the election. The 2008 election had a high rate of voter turnout, with a relatively high turnout among younger voters. How many people would’ve switched their vote to McCain and how many would’ve simply not gotten out and voted if Obama was white? Is it less than the 5% he was supposedly hurt by, greater than the 5%?

    • John Sides December 4, 2011 at 3:02 pm #

      Joe and Scott: See the Pasek et al. piece. They simulate (a) the elimination of anti-black attitudes and (b) the elimination of pro-black attitudes — as well as both at the same time. Moreover, they take into account the possibility of abstention.

  10. Spencer Piston December 10, 2011 at 6:41 pm #

    Thank you, Dr. Sides; I enjoyed this post very much.

    In particular, I agree with you that the relevant counterfactual is not
    “What would have happened absent racial prejudice?” but rather “What would
    have happened if Obama were White?” This is particularly a concern
    because to the extent that Democrats are perceived to be the party that
    benefits Black people, racial prejudice might hurt any Democrat, not just a
    Black Democrat (perhaps even after controlling for such factors as partisanship and ideology). So a strategy of examining the association of racial prejudice and voting behavior might suffer from this problem of a confounding variable.

    I have a paper in Political Behavior that attempted to deal with this issue by
    examining the effect of racial prejudice (as measured by a differential of
    ratings of Blacks and Whites on stereotype measures) on vote choice in each
    presidential election dating back to 1996.


    Other scholars have also been aware of this issue. For example, Tesler and Sears’ book used a similar strategy to mine (but a different measure of prejudice, racial resentment) and Stephens-Davidowitz controlled for Kerry vote in 2004. Donald R. Kinder and Allison Dale-Riddle have a forthcoming book on the topic as well.

    Finally, it’s interesting to note that while scholars appear to be in agreement that racial prejudice hurt Obama, the literature on the broader topic of whether White voters discriminate against Black candidates has yielded mixed results. For example, Dr. Highton’s 2004 article in Political Behavior, one of my favorite research projects on this topic, finds “remarkably little” evidence of White discrimination against Black candidates for Congress.


  11. J Burns November 13, 2012 at 9:48 pm #

    It is interesting that race was never overtly brought up in the election of 2008 and the election of 2012. It would be interesting to look at the why race wasn’t a factor from a psychological perspective: aversive racism and contemporary racism as well as other factors.