We recently offered an article about needing to “punish test” surveys lest you end up with a mess of mistakes like text piping that fails, or survey layouts that do not to adapt to user devices. But how do you actually punish test a survey? The best way, we think, is to start with a…
Testing a survey before it launches takes about 4 to 6 hours of an experienced professional’s time, for a standard ten- to fifteen-minute survey. If you don’t invest that time up front, you are almost certain to discover mistakes while in the field (or worse: after), which can make for a nightmare of programming corrections…
Contrary to some widely held beliefs that mobile devices are a barrier to survey participation, a majority of survey respondents nowadays fill them out on phones, rather than on desktops, laptops, or tablets. Research has amply documented that the quality and reliability of data collected via mobile devices is comparable to data collected on desktops.…
It is possible now to get thousands of responses to a survey overnight so that you can turn around research results as quickly as your managers and clients want. Would you trust the findings? I hope not. Suppose you want a general population survey that truly represents all U.S. adults. You will need to ensure…
If you read our article a few weeks ago about COVID-19, there were probably several statistics we cited that you (or maybe a colleague) misinterpreted. That’s because instead of reporting the percentage of respondents who did or said something, we reported the mean of all survey respondents’ answers to a numeric scale. We had no…
An important role for good survey researchers is to translate ridiculous sounding jargon their clients give them into ordinary words that real people use. The jargon is typically business or marketing related, because most surveys are done for business or marketing clients. But I just ran across some “marketing science” jargon (created by market researchers)…
Believe it or not, some people do not find puppies irresistibly adorable, as our newest honorary member of the Versta Research team (pictured here) can tell you. Elio arrived a couple of weeks ago. He is 13 weeks old and truly over-the-top adorable. He mostly sleeps in a crate next to me as I work…
The best way for you to get better survey data is to fix, optimize, and strategize your survey design. How? Abandon rote templates. Give up complexity. Think ahead to your analysis. Above all, put yourself in the shoes of a respondent. We market researchers complain when we get data back from surveys and see that…
What if a survey asks you a question that implies a yes-no answer (“Have you ever …”) but then offers you answer options that are different from what it implied (“often, sometimes, rarely, never”)? New research tells us that it depends on how the survey is administered. If the survey is online or on paper,…
Here is the e-mail subject line to a request I just received from a research company asking me to take a survey: Your Help Is Key to Our Success. I find it hilarious that somebody thinks this is an enticing subject line, as if I care deeply about their success. They really want me to…