Cost matters when you choose a sample or panel provider for your survey because there are good panels and bad panels. Bad panels provide survey respondents at cheap prices. But they do a lousy job managing and screening their members. Not surprisingly, a good portion of the data you get from bad panels will likely…
How big of a sample size do you really need? A recent article in the New York Times cited the following statistics: A small Voice of the Customer (VoC) research company called Mindshare Technologies collects satisfaction data from 175,000 respondents every day. That’s 60 million in a year. ForeSee, a small customer experience analytics firm…
Many of us in marketing research have been deploying web surveys for over ten years, and web surveys are, by far, the dominant mode of data collection in our industry nowadays. But our techniques and methods are an amalgam of practices adapted from other data collection modes, learned in part through trial and error, and…
Even if you are not involved in political polling, it is worth paying attention to the methods and best practices of political pollsters. One reason is that few other areas of research offer a way to completely validate one’s methods. Pollsters are using sampling and survey methods to predict the behaviors of a much larger…
Versta Research is a strong advocate for using online panels for surveys. As telephone usage and technology have changed, phone surveys are increasingly difficult and expensive, and they are not necessarily more rigorous than other methods. But that doesn’t mean “anything goes” when it comes to fielding market research surveys and public opinion polls through…
Is it true that the Associated Press refuses to carry stories from online surveys? Yes, as odd as that seems nowadays. But news media face a difficult problem given how easy it is to conduct biased public opinion polling, especially now with online panels and social networks. So some news organizations like the Associated Press…
The hardest part of quantitative market research is not that it involves numbers, math, or even statistics, but that it involves complex problems in probability. Over the past several years, psychologists have been documenting how difficult it is for us humans to solve even “simple” probability problems. One fascinating example is a puzzle known as…
The most recent government estimates of cell phone usage among U.S. households were released a few weeks back, and the pace at which landline usage is disappearing is astonishing. Here are just some of the numbers: Thirty percent of U.S. households do not have a landline telephone An additional 16% have a landline telephone, but…
These days most researchers agree that if you want to do a random sample phone survey of the U.S. population, you ought to include cell phones. More than one-quarter of the population do not have landline telephones at home. Those who do have landline telephones are less likely than ever to answer them, and less…
A good chart is the best way to understand the law of diminishing returns when it comes to sample size. So for our June 2011 newsletter we built an interactive graph for choosing sample size. It’s cool, educational, and useful. Moreover, it will show you just how mind boggling the numbers behind sampling can be. …