In our fall newsletter we purposely glossed over the “standard” best practices in writing surveys that one typically reads about in text books or learns in research methods classes. We wanted to give you a deep-dive into our own five last steps in writing a questionnaire that focused on advanced topics like randomization, programming logic,…
In quantitative survey research, the questionnaire affects nearly everything else that is critical to a study: the data, the analysis, and the findings. And because of this, writing surveys is the component of research that requires more on-the-job experience than any other. It requires thinking on multiple levels about all other aspects of the research…
Surveys run the gamut from silly to serious, and from sloppy to scientific. Occasionally we do something silly if a client insists (though we generally advise against it). But we never do sloppy surveys, and we hope you never do them either. Lean as far as possible towards rigor and science within reasonable constraints of…
There is a “user-friendly” feature that some survey platforms now offer, and almost certainly you should avoid it. It is called auto-advance. I had an unpleasant encounter with it in a customer survey I just took. The idea is that, after clicking on an answer, instead of having to move a mouse or finger all…
If you worry that cell phones make it harder to get high quality, thoughtful, and richly detailed data with surveys, stop worrying. New research from a trio of survey measurement scientists (one at the Census Bureau and two at University of Michigan’s Survey Research Center) shows there are no differences in data quality and measurement…
I once heard from an overzealous boss with a Ph.D. in political science that measurement scales should always have an odd number of scale points – the reason being that measurement scales should always have a neutral middle. We sometimes hear this from clients reviewing survey drafts as well: “Shouldn’t every question have a neither,…
Nobody gets really good at market research by taking classes. It comes from learning on the job and in the field from other researchers. That is because researchers are always solving new problems and answering new questions that have never been asked before. That inspired us to make our summer newsletter The Big “How To”…
If you want the most valid and reliable measures you can get, forget about NPS and other 11-point scales that so many companies use as their primary measure of customer satisfaction these days. It turns out that 2-point scales (yes vs. no, satisfied vs. dissatisfied, etc.) are far more reliable measures for gauging consumer attitudes.…
A feature story on the Versta Research website is about mapping shopper segments onto buyer segments. That story may have had you asking how we measured and defined those segments in the first place. The answer: by devising careful and nuanced survey questions to capture what our qualitative research partners learned about how consumers assess,…
Surveys don’t get much simpler than this. It is from the New York Times, which I typically admire for its rigorous reporting, thoughtful analysis, and forward-thinking experimentation with data visualization. But even with such simplicity, this survey (published on April 22, 2018) manages to be terrible in at least three big ways: It asks a…