Dividing a market into unique segments makes sense. But the statistical methods we rely on for segmentation often result in segments that are strongly differentiated in useless and misleading ways. A recent analysis of Facebook data by The New York Times illustrates this perfectly.
This familiar sentence opens the lead article of Public Opinion Quarterly’s 2017 special issue on survey research: “Telephone surveys are dead, claim some survey researchers, and should be replaced with nonprobability samples from Internet panels.” Hmm, I’ve said something similar to that in the past, I thought to myself. I guess I’m not the only…
One memorable lesson from reading Edward Tufte’s books about visual displays of quantitative information is that charts are not the only way to display data. Indeed, they are sometimes a worse way. We should always at least consider a table as a superior alternative: Tables are clearly the best way to show exact numerical values,…
Which of these two questions do you find more annoying, question A or question B? A. Foodie TV has announced a competition to select the best destination for food. What can your city do to win? B. In terms of the restaurant choices, what is important for a city to offer? Now which of these…
If you are a market research professional, I urge you to look for continuing education beyond the MR industry groups such as the Insights Association, Quirk’s, etc. and instead look to a more academic organization like AAPOR, the American Association for Public Opinion Research. Yes, their conferences will be the most boring you ever attend.…
At first I thought this was the dumbest survey question ever. Why ask people what device they are using to take the survey, when you know from the platform meta-data what device they are using? Yes, even lame self-service survey platforms can (and should be) capturing information about device, operating system, IP address, start time,…
It bugs me that companies would use customer feedback surveys not for information or learning, but to manipulate customers into buying from them again. On the other hand, how many companies inundate us with those zillions of customer satisfaction surveys because they truly care about learning? What they really care about are their “metrics,” their…
It all depends on what counts as a “question,” and also on how complex those questions are. A grid question with multiple rows takes a longer to answer than a simple yes-or-no question. A question that allows you to select multiple items from a laundry list of options takes longer than a standard 4-point scale.…
I have been surprised by the number of people—including friends and even veteran researchers within the market research industry—who believe that the outcome of the 2016 presidential election proved once and for all that surveys and polling do not work. Why am I surprised? Because it is simply not true. In the Versta Research Winter…
Almost certainly more than you think. If you are purchasing access to survey respondents from panel providers, or from survey software providers, or from any other source beyond your own list (and even then, how carefully are you controlling access to your survey?) you are probably getting fraudulent data from automated bots or from survey-taker…