I write a lot about how robots are messing up market research. But yesterday, I had the happy experience of a robot helping us in a surprising a way. It flagged an error in a list of competitive brands for an ATU study (Attitudes, Trial, and Usage)—an error that would invalidated our results if we…
Telling stories is a natural human behavior, but also highly complex and difficult to imitate or automate. This means that, happily, trolls can’t tell stories. And asking survey respondents for an extremely brief story (even just a few words) about their experience related to a survey topic can help you differentiate real respondents from fake…
I don’t know how big the Versta Research blog fan base is, but at the very least, the Quirk’s editors seem to follow us, and sometimes they ask for permission to reprint an article. Such was the case for an article we wrote last month about anonymity in research. The gist of that article was…
In our company we nearly always try to keep data collection “anonymous.” This means that for most of our surveys we intentionally do not know the identity of who participates (though our sample providers do). We rarely ask for any type of identifying information, not even a first name. If for some reason we have…
It really bugged me that I got this “survey” invitation last week, in part because it conforms so well to many of the best practices we advise for designing effective survey invitations. Take a look: It offers a generous incentive. It has a nice graphic saying how long the survey takes. It has a prominent…
A survey platform we have been using launched a new service promising an “expert review” of our surveys before we send them out for data collection. Unfortunately, it is a gimmick. It turns out that there are no experts reviewing our surveys. An artificial intelligence robot reviews them. It was interesting to see which best…
An unfortunate consequence of NPS (Net Promoter Score) mania is that now zillions of surveys stalk us everywhere. Therefore, the likelihood of any particular survey being completed is extremely low. That might be okay if you are a large company with hundreds of thousands of customers to burn through with e-mail blasts. But if you…
Let’s suppose that customers want to be surveyed. What is the best way to do it? Should we call them, send email, use text messaging, push surveys through mobile apps, or send old-fashioned paper surveys through the mail? This is a question we rarely ask in market research, because for most survey research we desperately…
Here is the e-mail subject line to a request I just received from a research company asking me to take a survey: Your Help Is Key to Our Success. I find it hilarious that somebody thinks this is an enticing subject line, as if I care deeply about their success. They really want me to…
This is the same survey I told you about a few weeks ago. It came back to me again, since I am part of the ABS-recruited probability-based panel that is fielding the survey. It is still one of the worst surveys I have ever seen. This time I took some screen shots: …