Here’s a sobering question for professionals who work in the “insights” industry: How much of your market research really offers insight? Not just validating data, or routine measurements, or pro forma tracking. Not just percentages of “how many said what” in a customized study. By true insight we mean: a direct answer to a deeply…
How many young African American men support Donald Trump? Not many. But if one of them ends up randomly selected into your survey, and if you use statistical weighting to ensure the sample does not skew too old and too white, then you are in trouble. This is what’s happening to the LA Times’ election…
A favorite pastime in my household is to laugh at the absurd statistics our local weatherman conjures up to make his reports sound dramatic, scientific, and driven by a deep analysis of data. Things like, “These are the first three consecutive days since 1989 of 90+ degree temperatures following an immediately preceding four-week string of…
I often look to excellent journalism as a model for how researchers should turn data into stories: Do investigative work, interview the right people, analyze the details, then lay out a meaningful and contextualized narrative about the who, what, when, where and why. In fact, when I talk about our research and analysis approach that turns data…
Last year, Gartner, which charts new trends and emerging technologies via its “Hype Cycle” tracking, decided to abandon its tracking of Big Data. The reason? Big data, they said, has become so ubiquitous and embedded in so many other technologies, that it is no longer a thing of its own. And yet, how many of…
The goal of great market research is to provide answers substantiated with data. To make that research really shine, the ultimate goal should be to Turn Data Into Stories. That is why, in the video we released earlier this year, we highlighted “turning data into stories” as the definitive last step to getting your research…
The hottest new job title invading the world of market research is “data scientist.” It has many of us starting to wonder, aren’t we all data scientists? Whether quantitative or qualitative, we spend most of our time collecting, manipulating, interpreting, and presenting data. Our methods are grounded in social science. Put the two together and…
How far should you go when reporting your findings, into the territory of interpreting your findings? An excellent researcher never stops struggling with that question, and the better you are, the more intense the discomfort every time you stretch away from the data to advise on what it all means. The importance of stretching beyond…
Whenever I write a research report, I feel strongly ambivalent about flagging data as “statistically significant.” If possible, I try to avoid it altogether. Why? Because p-values and concepts of statistical significance are often misunderstood, misused, and misleading. Indeed, the problem is so prevalent that one well-respected scientific journal in social psychology (Basic and Applied…
Just one month after publishing our Quick Puzzle for Market Research Brains (SPOILER ALERT! If you have not tried the puzzle yourself, do it now before continuing to read!) which demonstrated the dangers of confirmation bias, I read a report from the National Science Foundation (NSF), released in May, that warned of the same thing.…