We feel strongly that people who give us information through surveys, in-depth interviews, or focus group deserve a promise that this will never happen to them: Courtesy of WorkChronicles.com One of the tenets of rigorous market research is that respondent confidentiality is key. Why? Primarily because it benefits you as a client. To make smart…
Today I saw my first “dumb election statistics” article of the season, with AP News offering this dramatically titled story: Kamala Harris’ election would defy history. Just 1 sitting VP has been elected president since 1836. We are bound to see tons of headlines and stories like this during the next several weeks. It brought…
A few weeks we wrote about launching surveys over holidays, and we quoted research noting that there is scant evidence for the widespread assumption that holidays periods should be avoided. Lest you now find yourself working over the Christmas holiday trying to squeeze in the last round of data collection getting input from every last…
The pointy-hair boss has a point here, even though he does not realize it. From a research perspective, focus groups should provide rich, new, and surprising depths of insight, not necessarily “reliable” data. In fact, that’s why we typically suggest doing multiple focus groups, in different locations, with different types of participants. We want each…
When Dilbert starts making fun of the most common words in market research—actionable insights—it’s time to consider letting them go. And now that nearly every marketing and research professional, every market research firm, and every data analysis tool touts a unique ability to offer actionable insight, I think we can now safely agree that the…
A favorite pastime in my household is to laugh at the absurd statistics our local weatherman conjures up to make his reports sound dramatic, scientific, and driven by a deep analysis of data. Things like, “These are the first three consecutive days since 1989 of 90+ degree temperatures following an immediately preceding four-week string of…
In Turning Data into Stories we pointed out that numbers have no inherent meaning. There are no essentially big or small or significant numbers, for example—they only become big or small or significant within the context of specific research questions and a range of possible answers. The same is true for p-values by which we…
[SEE CARTOON] Of course those 99% keep reading the pointless polls, and most research firms are happy to keep generating pointless polls. The problem? Too few research firms are willing and able to help clients differentiate a survey that is informative and truly worthy of print, versus one that is pointless. So how do you…
Just last week a client proposed having their salespeople recruit customers to take the loyalty and satisfaction survey we had launched for them. It’s a terrible idea, for exactly the reasons that Dagwood realizes with his baffled look in this cartoon. If you want honest feedback that your business unit can honestly use to improve,…
Before the days of DATA MINING this was called DATA DREDGING. And for good reasons, because it was considered not a good thing. Almost any dataset will have nonsense correlations, and if you’ve turned on your magical statistical testing tool at the 95% confidence level, five out of every one hundred nonsense correlations will likely…