One resource that we give far too little thought in market research are the people who offer their time and thoughts about the stuff we are researching. They are truly the lifeblood of market research. An article in the spring 2011 issue of Public Opinion Quarterly looks at trends over the last thirty years in…
Contrary what a methodological purist in the social sciences might recommend, we often design survey questions with scales that have no neutral midpoint or don’t know option. For example, we sometimes use scales that look like this: Rather than this: Or this: Why? Because survey respondents tend to over-use neutral midpoints or don’t know options.
The latest data from the CDC’s National Health Interview Survey show that one quarter (25%) of U.S. adults do not have land-line telephones in their homes. So if you conduct a traditional random-digit-dial (RDD) phone survey, you will automatically be excluding one quarter of the population. Does it matter, given that surveys rarely interview everyone…
With the magic of the holidays upon us, we got to thinking about “magic” in market research, or the lack thereof. So our just- published quarterly newsletter focuses on magic numbers in market research, arguing that certain “magical” numbers seem to guide much of what we do, whether we realize it or not. The best…
The idea of sampling is not hard to grasp, but methodological discussions about sampling can quickly move into the higher reaches of mathematics and probability that confuse even researchers who are not statisticians. Ever wonder what we are talking about when we refer to “probability samples?” Or the rationale for not reporting margins of error? …
Should you state a survey’s margin of error in your press release when pitching a story to the media? In our view, the answer is no. Why not? Because margins of error refer to sampling error only, not about the overall accuracy or error of the survey itself. But how many readers of your news…
With the sad proliferation of silly surveys, non-scientific interest polls, and downright fraudulent polls, the research industry is stepping up with a number of key initiatives to combat the trend. Versta Research is part of that effort, and in August announced that we are part of the Transparency Initiative being developed by the American Association…
The idea that online panel surveys can replace telephone surveys ruffles feathers among my colleagues at the American Association of Public Opinion Research (AAPOR). So what would they think of using Twitter posts as a substitute for phone surveys? The idea seems crazy, but as reported in Science, researchers at Carnegie Mellon University have found…
In the old days (decades ago), phone surveys had limited utility because many people had no phone service in their homes. When that changed, phone surveys became ubiquitous because they allowed researchers better control over the process. Data quality improved. Now increasing numbers of people have moved to cell phones only, which has been a…
If something works and it keeps on working but you don’t know exactly why it works, what would you do? Our view is that you should keep doing it. Not everyone agrees with us. The American Association of Public Opinion Research (AAPOR) convened a task force to study online survey panels, and released their report…