Over the last few years it has become clear that random digit dial telephone surveys—once the gold standard of survey research—are no longer so golden. But the New York Times has been a holdout among media giants, refusing to use online polls or to report findings from them. They have clung to the false idea…
One of the most useful techniques for in-depth qualitative interviewing is to ask respondents not only what they think, but what their friends, family, or colleagues think. It opens a whole new level of conversation and insight because all of the sudden respondents feel free to talk about their understanding and assessment of the world…
Readers of this newsletter and blog know how much we value and respect the New York Times. It is one of the few resources we cite regularly, as it always has relevant, authoritative information that informs our work and that of our clients. So my heart sank when I read this description of a new…
Question order in surveys matters a lot more than most of us realize, which makes it critical to assess what you most want to know before your survey respondents are influenced (or, in the language or survey experts, “primed”) by additional questions on the topic. Here is a superb example from last fall’s political polling…
The Associated Press (AP) announced last month it is moving all of its public opinion polling from phone surveys to online surveys. This is progress, because over the last decade AP has been one of a handful of media holdouts (along with ABC News and The New York Times) who have insisted that only phone-based…
The purists in the polling industry who have always insisted that only probability sampling is valid may finally be accepting that their methods are dead. This is one happy conclusion I draw from the debate over AAPOR’s recent task force report on non-probability sampling, which is nicely summarized (and debated) as the lead article of…
Even if you don’t care about political polling, or the fact that Gallup consistently overestimates support for Republican candidates, it is worth paying attention to how Gallup is trying to fix its problems with surveys and polling. They are not happy with how poorly their polls have fared (who would be?), and they have teams…
It is hard to find an appropriate use for Google Surveys, because, as we outlined in a review article last fall, its capabilities are limited. But last week we needed a quick incidence test of how many U.S. adults own a certain type of investment product. Google Surveys seemed perfect. It was not fast, by…
With all our excitement over the last few months about the accuracy of online polling during the election season—substantially outperforming “gold standard” telephone research—there was not time to share ESOMAR’s September 2012 updated guide to purchasing online sample. The guide consists of 28 questions all purveyors of online sample should answer, publish, and make available…
If there is one super important lesson to be learned from this year’s round of election polling, it is that online surveys work. Google Consumer Surveys, which use non-probability online samples, predicted the election far better than Gallup did. And online surveys, overall, outperformed telephone surveys. The New York Times’ Nate Silver compiled polling results…