Some respondents answer survey questions with the same answer over and over again. They agree to everything, or they give identical numeric ratings to all items. It’s called “straight-lining,” and we often consider this a sign of poor data quality. I was intrigued by an approach to mitigating the problem I learned last week, shared…
The evidence continues to mount that phone surveys should be a method of last resort. Pew Research Center has released results of an experiment conducted in 2014 to test mode differences in how surveys are administered. The research question was whether people answer survey questions differently when responding to a real person on a telephone…
I am the Internet user that advertisers dread. I block as much advertising, video, flash content, and java script as I possibly can so that I stay focused on work without all that annoying, flashing, moving stuff trying to grab my attention. This always makes me wonder: Am I the Internet user that market researchers…
If ever there were evidence that phone surveys are dead, it’s this: Gallup, the undisputed king of telephone polling for decades, has withdrawn from the race. The firm announced last week that it will not conduct candidate polling for the 2016 presidential election. This comes after the miserable failure of its polling in 2012, which…
Having jumped back into the 1,016-page Reference Manual on Scientific Evidence from the Federal Judicial Center and the National Research Council (see last week’s article on Defending Your Statistics in Court), I keep finding fascinating nuggets of information worth sharing with our marketing and research colleagues of all stripes. Consider this snippet from the section…
If you found that 10% of your online survey respondents were ignoring your questions, generating random data, and there was an easy way to identify who those respondents were, what would you do? I hope you would delete them, go back to the field, and replace them. But for some reason there are those among…
OK, using the word stalker instead of remarketing lists is harsh, but it perfectly conveys the idea behind Google Consumer Surveys’ (GCS) latest innovation for market research. You can use cookie lists from web pages to target people based on specific content they are viewing. Want to survey people who were on your website last…
Two of my usually-favorite sources for information and insight (AAPOR and the New York Times) came together this week with an embarrassing, face-scrunching example of convoluted statistical reporting: But Internet use correlates inversely with age and voting habits, making [online polling] a more severe problem in predicting elections. While all but 3 percent of those…
If you are not testing all of your surveys for how they function on mobile, you absolutely should be. Almost half of respondents in our most recent U.S. census-rep survey completed the survey on mobile devices. This included 30% who completed it on phones, and 17% who completed it on tablets. Here is a quick…
Sometimes technology moves so fast it solves a problem before we solve it in other ways. Such is the case with grid-type questions and mobile surveys. People are doing surveys on mobile devices all the time now, so researchers are finally re-thinking how to design surveys. Getting rid of grids has been one mantra of…