It is hard to find an appropriate use for Google Surveys, because, as we outlined in a review article last fall, its capabilities are limited. But last week we needed a quick incidence test of how many U.S. adults own a certain type of investment product. Google Surveys seemed perfect. It was not fast, by…
After leaving academic research for the world of applied research, I found myself doing a lot of surveys for public relations. These surveys are designed to uncover surprising or newsworthy nuggets of data that companies use to focus attention on topics relevant to their concerns. My first boss despised such work, believing that a public…
With all our excitement over the last few months about the accuracy of online polling during the election season—substantially outperforming “gold standard” telephone research—there was not time to share ESOMAR’s September 2012 updated guide to purchasing online sample. The guide consists of 28 questions all purveyors of online sample should answer, publish, and make available…
If there is one super important lesson to be learned from this year’s round of election polling, it is that online surveys work. Google Consumer Surveys, which use non-probability online samples, predicted the election far better than Gallup did. And online surveys, overall, outperformed telephone surveys. The New York Times’ Nate Silver compiled polling results…
I have never been a media poll watcher or politics junkie who tracks every new poll saying which candidate is favored to win. It is hard to see the point of spending so much time and money predicting the outcome of an event that will be known with certainty within a matter of days, weeks,…
What IS a credibility interval, you ask? It is a term making its way into mainstream market research just as Bayesian statistics are making their way into market research. A credibility interval provides a range of values, calculated using Bayesian statistical techniques, within which a statistical estimate is likely to fall. It is analogous to…
Six months ago Google launched an intriguing new way to conduct cost-effective surveys that offers an alternative to omnibus surveys. One or two easy survey questions are presented to online users as they seek access to high quality media sites. They gain free access in exchange for answering the survey questions. Google tracks how many…
During a presidential election year there is no escaping the flurry of public opinion polling and the intense scrutiny that surveys get from the media. But love it or hate it, there are excellent reasons to pay close attention to this year’s political polling.
Way back in 1944, Edwards Deming published an article in the American Sociological Review that could be required reading for anybody who does research today. He outlined all potential (and unfortunately, common) sources of error in survey research. Apparently our contemporary obsession with sample sizes, random samples, response rates, and margins of error is not…
A couple weeks ago we presented new data showing that response rates continue to decline. You can now expect that a typical, rigorously executed phone survey will yield a response rate in the single digits. Scientific evidence over the last decade has shown that high response rates do not necessarily yield more accurate surveys. In…