For all the high level intellectual work you do in research (statistical work, design work, analysis, or writing) there is just as much brute force effort you need to put into fieldwork. That means finding the people to interview, convincing them to participate, asking them questions, and recording their answers. Even if you outsource, keeping…
Some respondents answer survey questions with the same answer over and over again. They agree to everything, or they give identical numeric ratings to all items. It’s called “straight-lining,” and we often consider this a sign of poor data quality. I was intrigued by an approach to mitigating the problem I learned last week, shared…
There are good reasons to avoid phone surveys if you can. But if there is no alternative, it is critical to think about strategies for integrating cell phones into your outreach and sampling. Almost half (48%) of U.S. adults have no landline telephone service, while fewer than one in ten (9%) have no cell phone…
If ever there were evidence that phone surveys are dead, it’s this: Gallup, the undisputed king of telephone polling for decades, has withdrawn from the race. The firm announced last week that it will not conduct candidate polling for the 2016 presidential election. This comes after the miserable failure of its polling in 2012, which…
Difficult or lengthy surveys require hefty incentives, which unfortunately makes it tempting for some respondents to lie. We are facing this predicament in a survey right now. The survey requires two people from the same household who share household finances to complete parallel surveys. We are recruiting from an online research panel. Person 1 gets…
Despite the welcome trend towards online polling, telephone surveys are still surprisingly common, and telephone outreach makes sense for certain types of research. But if you ever use or commission phone surveys, take note: do not use automated dialing to make calls. Instead, have interviewers manually dial the numbers so you don’t get caught in…
OK, using the word stalker instead of remarketing lists is harsh, but it perfectly conveys the idea behind Google Consumer Surveys’ (GCS) latest innovation for market research. You can use cookie lists from web pages to target people based on specific content they are viewing. Want to survey people who were on your website last…
If you are not testing all of your surveys for how they function on mobile, you absolutely should be. Almost half of respondents in our most recent U.S. census-rep survey completed the survey on mobile devices. This included 30% who completed it on phones, and 17% who completed it on tablets. Here is a quick…
A perennial problem with open-ended survey questions is that respondents are lazy. It takes time and effort to think of good answers. And if the survey is self-administered online or on paper, it takes time and effort to write them out. But there are several things a savvy researcher can do. One of them is…
Getting good responses to open-ended questions via online surveys is a challenge. So much so, that new technologies have evolved to probe on responses just as live interviewers used to probe people on phone surveys. But can you get really outstanding open-end responses to online surveys without fancy technology? The answer is yes, it just…