What if a survey asks you a question that implies a yes-no answer (“Have you ever …”) but then offers you answer options that are different from what it implied (“often, sometimes, rarely, never”)? New research tells us that it depends on how the survey is administered. If the survey is online or on paper,…
Here is the e-mail subject line to a request I just received from a research company asking me to take a survey: Your Help Is Key to Our Success. I find it hilarious that somebody thinks this is an enticing subject line, as if I care deeply about their success. They really want me to…
Survey questions that have multiple response options with an instruction to “select all that apply” are common in our industry, and for good reasons. They are efficient and easy for respondents to answer. They are efficient to lay out graphically. They shorten the length of a survey in terms of both time and space. The…
The online customer satisfaction survey I received today had me noticing an unfortunate side-effect of the NPS (Net Promoter Score) schema and visual imagery. For those of you unfamiliar with NPS as a way to measure and track customer satisfaction, here is how it goes. In your survey ask: “How likely are to recommend Acme…
There are two things that make me most proud of my company, Versta Research. First is the work that clients pay us to do, because we put so much thought, care, and rigor into delivering the insights they need. Nothing goes out the door without me feeling like we’ve “owned” the work completely, and I…
In our fall newsletter we purposely glossed over the “standard” best practices in writing surveys that one typically reads about in text books or learns in research methods classes. We wanted to give you a deep-dive into our own five last steps in writing a questionnaire that focused on advanced topics like randomization, programming logic,…
In quantitative survey research, the questionnaire affects nearly everything else that is critical to a study: the data, the analysis, and the findings. And because of this, writing surveys is the component of research that requires more on-the-job experience than any other. It requires thinking on multiple levels about all other aspects of the research…
Like other professionals, those of us in marketing and market research sometimes fall too much in love with our specialized and often ridiculous language. It is mostly okay when we communicate with each other. But if we are communicating with customers or consumers, beware. Our words may not be their words. And since our research…
There is a “user-friendly” feature that some survey platforms now offer, and almost certainly you should avoid it. It is called auto-advance. I had an unpleasant encounter with it in a customer survey I just took. The idea is that, after clicking on an answer, instead of having to move a mouse or finger all…
I once heard from an overzealous boss with a Ph.D. in political science that measurement scales should always have an odd number of scale points – the reason being that measurement scales should always have a neutral middle. We sometimes hear this from clients reviewing survey drafts as well: “Shouldn’t every question have a neither,…