This week we published Versta Research’s quarterly newsletter with a feature article entitled “Wisdom in an Age-Old Question.” While it might seem simple to ask a person’s age on a survey, it turns out that there are all sorts of ambiguities and documented sources of error in the various ways you might ask it. Fortunately,…
If there is one super important lesson to be learned from this year’s round of election polling, it is that online surveys work. Google Consumer Surveys, which use non-probability online samples, predicted the election far better than Gallup did. And online surveys, overall, outperformed telephone surveys. The New York Times’ Nate Silver compiled polling results…
Six months ago Google launched an intriguing new way to conduct cost-effective surveys that offers an alternative to omnibus surveys. One or two easy survey questions are presented to online users as they seek access to high quality media sites. They gain free access in exchange for answering the survey questions. Google tracks how many…
A mistake often made by both professional and do-it-yourself researchers is letting a survey sit in the field without actively monitoring it. Once we design a survey and put it out there for people to respond, we just wait patiently (or get busy on another project) until we have data for analysis, right? But collecting…
Fifteen years ago the U.S. Census Bureau removed “Hispanic” from its question about race and instead created a stand-alone question to assess Hispanic ethnicity. It’s the reason we often advise our clients to ask about race and ethnicity separately, using questions similar to the Census Bureau’s, which are shown in Figure 1. Well, chances are…
During a presidential election year there is no escaping the flurry of public opinion polling and the intense scrutiny that surveys get from the media. But love it or hate it, there are excellent reasons to pay close attention to this year’s political polling.
Way back in 1944, Edwards Deming published an article in the American Sociological Review that could be required reading for anybody who does research today. He outlined all potential (and unfortunately, common) sources of error in survey research. Apparently our contemporary obsession with sample sizes, random samples, response rates, and margins of error is not…
When all of the hype and uncertainty around social media settles down, market researchers will likely see it as “merely” another useful channel through which to gather data and opinions from the audiences they care about, just like surveys, focus groups, or ethnographies. In the meantime it is good fun to read articles, like this…
A couple weeks ago we presented new data showing that response rates continue to decline. You can now expect that a typical, rigorously executed phone survey will yield a response rate in the single digits. Scientific evidence over the last decade has shown that high response rates do not necessarily yield more accurate surveys. In…
Survey response rates are now staggeringly low—in the single digits. A typical response rate for a relatively high-budget, carefully executed phone survey is merely 9%, down from 36% just fifteen years ago. Here are the numbers from research conducted earlier this year by the Pew Center: If you want to throw money at a survey…