Pixel Tracker

Sunday, March 24 , 2019, 11:44 am | A Few Clouds 60º

 
 
 
 

Michael Barone: Where the Polls Were Wrong — And, Maybe, Why

Were the polls wrong? It's a question asked after every election. Sometimes, as in 1948, the answer seems as obvious as the answer to the question, "Why did Custer lose at Little Bighorn?" Sometimes the answer is less obvious, as it is this year.

"The polls were skewed toward the Democrats," writes Nate Silver, who as proprietor of FiveThirtyEight has earned the distinction of being the nation's most assiduous polling analyst.

Silver gives short shrift to partisans — Democrats this year, Republicans in 2012 — who complained that polls were systematically biased against their side. The skew varies unpredictably, he says, perhaps because pollsters overcompensate in response to previous mistakes. He finds polls skewed against Democrats in 2006 and 2012 and against Republicans in 2002 and 2014 — all winning years for those parties.

Silver measures the skew by comparing the percentage margin for candidates in his website's average of the most recent pre-election polls to the percentage margin for candidates in the actual results. He finds that Republicans this year won bigger margins than in the polls in 24 of 36 Senate races and 28 of 35 governor's races.

Here's another way of looking at it, concentrating on those races that were seriously contested. In seriously contested Senate races — the chief event of this election cycle — the polls were quite accurate in presaging the percentages received by seven Democratic incumbents. Those Democrats ran from 3.2 percent ahead to 1.7 percent behind their RealClearPolitics polling averages. Also, three of the four Democrats running in open Democratic seats ran within that range of poll results.

Where the polls missed was in projecting Republicans' votes in Republican-held seats. Pat Roberts ran 10.6 percent ahead of polls in Kansas, Mitch McConnell 7.2 percent ahead in Kentucky and David Perdue 5.2 percent ahead in Georgia.

There's a similar but not identical pattern in seriously contested races for governor. In seven states where Democrats were defending governorships, Democratic nominees ran very close to the polls in five. Only in two close New England races, where polls had high undecideds, did they run further ahead.

In nine states with Republican-controlled governorships, Republicans all ran ahead of their poll numbers, from 3.2 percent in Alaska (where final results are not in at this writing) to 7.4 percent in Kansas.

All this suggests that pollsters did a better job of finding Democratic voters than they did of finding Republican voters. That accounts for the Democratic tilt in polling Silver finds when looking at candidates' percentage margins rather than percentage totals.

One possible reason is that Republican-leaning voters were more hesitant than Democratic-leaning voters about committing to vote for their party's candidates. The bulk of those undecided in polls in Kansas, Kentucky and most of the states with Republican governors were Mitt Romney voters in 2012.

There has been a similar phenomenon when pollsters ask people to rate the two parties' members of Congress. During most of this campaign cycle (but less so toward the end), Republicans in Congress were getting lower ratings than Democrats in Congress because more Republican voters gave their own party's members negative ratings.

Another possible reason, advanced by Henry Olsen of the Ethics & Public Policy Center, is that pollsters are doing a poorer job of sampling opinion in rural areas than in large metropolitan areas. Outside their states' three major metropolitan areas, Roberts won 63 percent of the vote, and McConnell won 61 percent. Polls seem to have missed this.

A third possible explanation — and all three may be overlapping — offered by RealClearPolitics analyst Sean Trende is that local pollsters were able, because of their greater experience and understanding of their states, to spot Republican trends that national pollsters missed. Trende credits the University of Arkansas poll, Ann Selzer's Des Moines Register poll in Iowa and Charles Franklin's Marquette University Law School poll in Wisconsin.

Pollsters face an increasingly difficult task. Telephone polling techniques were developed in a nation with universal landline phone service and a population that answered the phone when it rang. We no longer live in such a nation.

Only 9 percent of pollsters' calls resulted in completed interviews, the Pew Research Center reported in 2012. Maybe rural Republican voters are harder to reach or maybe they're too grumpy to commit until they have to.

In 1948, Gallup famously stopped polling eight days before the election, and "Dewey Defeats Truman" became one of history's most famous headlines. Gallup stayed in the field later after that had happened. The good news is that today's pollsters, too, can learn from experience.

Michael Barone is a senior political analyst for The Washington Examiner, a resident fellow at the American Enterprise Institute, a Fox News Channel contributor and a co-author of The Almanac of American Politics. Click here to contact him, follow him on Twitter: @MichaelBarone, or click here to read previous columns. The opinions expressed are his own.

Support Noozhawk Today!

Our professional journalists work tirelessly to report on local news so you can be more informed and engaged in your community. This quality, local reporting is free for you to read and share, but it's not free to produce.

You count on us to deliver timely, relevant local news, 24/7. Can we count on you to invest in our newsroom and help secure its future?

We provide special member benefits to show how much we appreciate your support.

Email
I would like give...
Great! You're joining as a Red-Tailed Hawk!
  • Ask
  • Vote
  • Investigate
  • Answer

Noozhawk Asks: What’s Your Question?

Welcome to Noozhawk Asks, a new feature in which you ask the questions, you help decide what Noozhawk investigates, and you work with us to find the answers.

Here’s how it works: You share your questions with us in the nearby box. In some cases, we may work with you to find the answers. In others, we may ask you to vote on your top choices to help us narrow the scope. And we’ll be regularly asking you for your feedback on a specific issue or topic.

We also expect to work together with the reader who asked the winning questions to find the answer together. Noozhawk’s objective is to come at questions from a place of curiosity and openness, and we believe a transparent collaboration is the key to achieve it.

The results of our investigation will be published here in this Noozhawk Asks section. Once or twice a month, we plan to do a review of what was asked and answered.

Thanks for asking!

Click Here to Get Started >

Reader Comments

Noozhawk is no longer accepting reader comments on our articles. Click here for the announcement. Readers are instead invited to submit letters to the editor by emailing them to [email protected]. Please provide your full name and community, as well as contact information for verification purposes only.