We recently offered an article about needing to “punish test” surveys lest you end up with a mess of mistakes like text piping that fails, or survey layouts that do not to adapt to user devices. But how do you actually punish test a survey? The best way, we think, is to start with a…
Testing a survey before it launches takes about 4 to 6 hours of an experienced professional’s time, for a standard ten- to fifteen-minute survey. If you don’t invest that time up front, you are almost certain to discover mistakes while in the field (or worse: after), which can make for a nightmare of programming corrections…
This summer you will not have to schlep to Ann Arbor for a month if you want to take advantage of top-notch summer training courses in survey research offered at the University of Michigan. Everything is being offered online this year! It is a perfect opportunity for corporate researchers and others who work on the…
Contrary to some widely held beliefs that mobile devices are a barrier to survey participation, a majority of survey respondents nowadays fill them out on phones, rather than on desktops, laptops, or tablets. Research has amply documented that the quality and reliability of data collected via mobile devices is comparable to data collected on desktops.…
It is possible now to get thousands of responses to a survey overnight so that you can turn around research results as quickly as your managers and clients want. Would you trust the findings? I hope not. Suppose you want a general population survey that truly represents all U.S. adults. You will need to ensure…
If demographic benchmarks and trends are essential to your business and the research you conduct (things like age, gender, race, ethnicity, and region) then our just-published 2020 Spring Newsletter has information you absolutely need to know. The U.S. Census Bureau continues to change how it collects and classifies demographic data. Right now the Bureau is…
In basic stats class, all of us learned about the importance of random sampling. It provides the foundation for the iron-clad mathematics of estimation, statistical significance, and margins of error. But the problem in social science, market research, and opinion polling is that random sampling (sometimes referred to as probability sampling) almost never exists. So…
I write a lot about how robots are messing up market research. But yesterday, I had the happy experience of a robot helping us in a surprising a way. It flagged an error in a list of competitive brands for an ATU study (Attitudes, Trial, and Usage)—an error that would invalidated our results if we…
Telling stories is a natural human behavior, but also highly complex and difficult to imitate or automate. This means that, happily, trolls can’t tell stories. And asking survey respondents for an extremely brief story (even just a few words) about their experience related to a survey topic can help you differentiate real respondents from fake…
I don’t know how big the Versta Research blog fan base is, but at the very least, the Quirk’s editors seem to follow us, and sometimes they ask for permission to reprint an article. Such was the case for an article we wrote last month about anonymity in research. The gist of that article was…