| Sun | Mon | Tue | Wed | Thu | Fri | Sat |
|---|---|---|---|---|---|---|
| 1 | 2 | 3 | ||||
| 4 | 5 | 6 | 7 | 8 | 9 | 10 |
| 11 | 12 | 13 | 14 | 15 | 16 | 17 |
| 18 | 19 | 20 | 21 | 22 | 23 | 24 |
| 25 | 26 | 27 | 28 | 29 | 30 | 31 |
« Call for Papers: Conference at Harvard on Networks in Political Science | Main | Nickerson on “How (and how not) to Study Voter Registration Experimentally” »
9 January 2008
New Hampshire voted last night, and managed to set off another frenzy of introspection among pollsters and pundits. On the Democratic side, public polls released after Iowa showed Obama leading Clinton by an average of about 10 points, but in the end Clinton of course edged out a narrow victory. The polls were much closer on the Republican side, but the "miss" on the Democratic side has already produced much concern about "New Hampshire's Polling Fiasco". Perhaps the witch-hunt that ensues whenever polls appear to be inaccurate in a major election should be viewed as a positive sign about the acceptance of survey research in the media and electorate; at the very least, these kinds of things keep a fair number of our colleagues gainfully employed. From my perspective, it would have been nice to have polls that were more consistent with the eventual outcome since we were planning to use them as examples in an undergraduate class; they will still be examples, but now the focus will be more on total survey error.
Why did the poll results diverge from the outcome? Several hypotheses are floating around. Jon Krosnick from Stanford has an opinion piece pointing to the ballot order effect; Hillary Clinton won the random draw to end up near the top of the ballot. There is certainly a lot of evidence that ballot-order effects matter, but my sense of the literature is that these effects tend to be smaller for better-known candidates, and it is hard to imagine a candidate better known than Hillary Clinton. Dan Ho and Kosuke Imai have written two articles on elections California that take advantage of randomization to estimate ballot-order effects:
More comment has focused on the possibility that Obama suffered from the "Bradley effect", in which some white voters say that they will support a black candidate when responding to poll questions but end up voting for a white candidate at the ballot box. There is not much academic literature on this supposed effect; here is a Pew Research Center note from last year; ironically, it is titled "Can you trust what polls say about Obama's electoral prospects?"
Finally, many observers have pointed to political prediction markets as either a supplement or alternative to traditional polls for predicting election outcomes, on the idea that these can incorporate other sources of information and require participants to put their money where their mouth is. They didn't do so well, either, as Jon Tierney notes on his New York Times blog, although the market prices did begin to move during the day. There is an interesting research agenda regarding the relative merits of polls and markets (and how markets integrate the information from various polls); Bob Erikson and Justin Wolfers, who are leading contributors to this literature, have an interesting exchange on this question on Andrew Gelman's blog (posted a week before New Hampshire, but even more interesting today).
Posted by Mike Kellermann at January 9, 2008 10:57 AM
I have not seen the details of the pre-primary polls, only the Clinton v. Obama spreads. What percentage of the respondents were undecided? CNN mentioned that, based on exit polls, a large share of the women who decided to support HC made that decision the day of the primary. If so, they could not be picked up by the pre-primary surveys.
Also, did these polls report the percentage of potential respondents that declined to be interviewed. I imagine that in NH during primary season the number is quite high.
Posted by: c.l. ball at January 9, 2008 12:49 PM
Perhaps I'm missing something on the "Bradley Effect" scenario, but I don't think it holds water here. If I'm wrong, please correct me.
If an appreciable number of voters lied to pollsters about intending to vote for Obama, then the polls would overstate Obama's vote. However, the polls got Obama's vote exactly correct. Since the polls did not overstate Obama's vote, there is no Bradley Effect.
Bruce
Posted by: Bruce McCullough at January 10, 2008 9:15 AM
It's hard to say, given the lack of an academic literature defining exactly what the Bradley effect is and if it even existed in Bradley's election, much less this one. One potential objection to the "polls did not overstate Obama's vote" explanation is that it seems to imply all of the undecided voters broke for Clinton in order to lift her above Obama; if that is the case, then there is a problem with the exit polling data, which shows a much closer split between late-deciding voters.
Just to be clear, I'm not saying that there was a "Bradley effect" in New Hampshire, but the idea is out there; Andrew Kohut from Pew has an op-ed in the Times today on precisely this question:
Getting it wrong.
Posted by: Mike Kellermann at January 10, 2008 10:13 AM
Could you explain to me what you mean with the Bradley effect? Regards
Posted by: Brommerverzekering at January 10, 2008 11:04 AM
Wouldn't the Bradley affect also apply to Hillary Clinton since she's a woman?
Posted by: Rodney at January 11, 2008 2:45 AM
I'm hoping someone can tell me why this analysis is wrong:
Using this data from the NH democratic primaries I regress Clinton's votes on the total number of votes per district, Obama's votes, whether the district's value was a hand- or diebold-count, and the interaction of the latter two.
The interaction is significant and indicates disproportionately higher allocation of votes to Hillary from Diebold machines only in those districts where Obama has a higher proportion of the vote (p=.013).
What does this mean, and if nothing, why?
Posted by: CHCH at January 11, 2008 6:38 PM
Very interesting, CHCH. Could you do a similar analysis on the republican results? It would be nice to have a baseline for the variance.
Posted by: Stuart LaForge at January 14, 2008 1:22 AM
Stuart, that's a great idea.
UPDATE: there was a discrepancy between blackboxvoting.org's files for diebold vs. hand-count NH districts and those maintained by the government. when I redo the analysis with the gov't's numbers there is still a significant interaction, but it goes in the opposite direction. However, the interaction of the quadratic effect of obama votes with the diebold var (controlling for population, age, education, the simple effect of the diebold var, and the simple and quadratic effects of obama votes) goes in the direction I mentioned in my earlier comment.
But this is beyond my comfort-zone for interpreting stats, so I was hoping someone here might be able to help... Let me know if you want a copy of the file.
Posted by: CHCH at January 14, 2008 1:59 PM
Would it be possible to doa similar analysis on the republican results?
Posted by: Max at January 16, 2008 3:28 PM
It is possible - I haven't done it but have heard from others who have that the apparent diebold effect for Romney *can* be eliminated with these covariates, perhaps providing additional confidence in the idea that the Diebold effect is real in the case of clinton/obama.
Posted by: CHCH at January 16, 2008 7:42 PM
The candidate with the best Healthcare Reform Policy should win the Presidential election.
Over 46.6 million Americans are uninsured, with 15.9 percent of Americans lacking health coverage.
Census data show that 46.6 million Americans were uninsured in 2005, an increase of 1.3 million from the number of uninsured in 2004 (45.3 million). The percentage who are uninsured rose from 15.6 percent in 2004 to 15.9 percent in 2005. The number of children who are uninsured rose from 7.9 million in 2004 to 8.3 million in 2005.
Posted by: William Hill at January 22, 2008 10:50 PM
The term "Bradley effect" comes from a 1982 campaign involving Tom Bradley, the long-time black mayor of L.A. He ran as the Democratic party's candidate for Governor of California against Republican candidate George Deukmejian, who was white. The polls consistently showed Bradley with a lead. However, Bradley narrowly lost the race. Post-election research indicated that a smaller percentage of white voters actually voted for Bradley than polls had predicted, and that voters who had been classified by those polls as "undecided" had gone to Deukmejian in statistically anomalous numbers.
Posted by: Malcolm Lambe at February 2, 2008 11:00 AM
Stuart, that's a great idea.
Posted by: ilanlar at February 12, 2008 3:00 AM
Very interesting, CHCH.
Posted by: Femina at February 12, 2008 3:00 PM
Stuart, I would also like to see this.
Posted by: lapband
at February 22, 2008 11:23 AM
Thanks, this information it was very useful to me.
Posted by: Oyun at February 24, 2008 7:25 PM