Difficult or lengthy surveys require hefty incentives, which unfortunately makes it tempting for some respondents to lie. We are facing this predicament in a survey right now. The survey requires two people from the same household who share household finances to complete parallel surveys. We are recruiting from an online research panel. Person 1 gets…
In our experience, the people who write the best questionnaires are researchers who spend their time immersed in complex survey methods and quantitative analysis but who focused on qualitative research earlier in their careers. Why? Because they are deeply sensitive to the dual objectives of survey design, namely: (1) Elicit data in specific ways and…
If you found that 10% of your online survey respondents were ignoring your questions, generating random data, and there was an easy way to identify who those respondents were, what would you do? I hope you would delete them, go back to the field, and replace them. But for some reason there are those among…
OK, using the word stalker instead of remarketing lists is harsh, but it perfectly conveys the idea behind Google Consumer Surveys’ (GCS) latest innovation for market research. You can use cookie lists from web pages to target people based on specific content they are viewing. Want to survey people who were on your website last…
Two things bugged me about the market research survey invitation I got from my alma mater. First, it was a mediocre three star survey that asked me a bunch of information they could easily have gotten from my LinkedIn profile. Second, it offered a chance to win a prize if I participated, and the effort…
Just last week a client proposed having their salespeople recruit customers to take the loyalty and satisfaction survey we had launched for them. It’s a terrible idea, for exactly the reasons that Dagwood realizes with his baffled look in this cartoon. If you want honest feedback that your business unit can honestly use to improve,…
Last week we wrote about social media and market research, and suggested that industry experts agree it is not yet shaking the foundations of how we do research. So what about the other gigantic Internet development of the last decade—mobile technology? It should be shaking the foundations of how we do research. Current estimates are…
Every year I enjoy getting an invitation to participate in Bon Appétit’s “most important survey of the year” because it provides so many good lessons for survey research. This year it has me thinking about the absurd e-mail subject line that says: “We need your help to get 100% participation.” Bon Appétit has 1,442,388 subscribers. …
Progress bars that show respondents how far along they are in a survey have become standard in our industry. But are progress bars a documented “best practice” for survey research, or just another convention? A recent article in the Social Science Computer Review offers a meta-analysis of 32 field experiments designed to see whether progress…
One way to get more people responding to your survey is to let them know ahead of time that the survey is coming their way. Is one method of outreach better than another? It depends on your audience and the type of survey, but several studies over the last decade have shown a consistent difference…