Here’s a sobering question for professionals who work in the “insights” industry: How much of your market research really offers insight? Not just validating data, or routine measurements, or pro forma tracking. Not just percentages of “how many said what” in a customized study. By true insight we mean: a direct answer to a deeply…
Whenever you see those “margin of error” statements on political polls and other published surveys (even in market research industry publications, unfortunately!) take them with a grain of salt. They reflect only one type of potential error in surveys: namely, sampling error associated with sample size. Chances are that the “real” margin of error (if…
How many young African American men support Donald Trump? Not many. But if one of them ends up randomly selected into your survey, and if you use statistical weighting to ensure the sample does not skew too old and too white, then you are in trouble. This is what’s happening to the LA Times’ election…
The last presidential election was a stunning win for online polls and a drubbing defeat for telephone polls. It provoked a loud and contentious debate among survey methodologists about the accuracy of polls and about how (and whether) to revise our methods. So here we are again, four years later with technology having moved faster…
A favorite pastime in my household is to laugh at the absurd statistics our local weatherman conjures up to make his reports sound dramatic, scientific, and driven by a deep analysis of data. Things like, “These are the first three consecutive days since 1989 of 90+ degree temperatures following an immediately preceding four-week string of…
Who can resist those flashy brain image scans showing that certain words, colors, images, or brands (or maybe your latest marketing message) magically light up consumers’ brains, presumably making them want to buy? Or, if you’re a cynic, who can resist sharing with colleagues the brain image scan of a dead salmon showing brain activity…
I often look to excellent journalism as a model for how researchers should turn data into stories: Do investigative work, interview the right people, analyze the details, then lay out a meaningful and contextualized narrative about the who, what, when, where and why. In fact, when I talk about our research and analysis approach that turns data…
Last year, Gartner, which charts new trends and emerging technologies via its “Hype Cycle” tracking, decided to abandon its tracking of Big Data. The reason? Big data, they said, has become so ubiquitous and embedded in so many other technologies, that it is no longer a thing of its own. And yet, how many of…
The goal of great market research is to provide answers substantiated with data. To make that research really shine, the ultimate goal should be to Turn Data Into Stories. That is why, in the video we released earlier this year, we highlighted “turning data into stories” as the definitive last step to getting your research…
Most companies test new product or service ideas with concept tests to evaluate market interest and to refine their ideas. Most of these (like most surveys, nowadays) are conducted online, which offers speed and cost efficiency. But there is a downside. While people are quite adept at reviewing ideas and answering questions in online formats,…