There are no magic numbers for sample size. There is no such thing as a statistically significant sample. Unfortunately, those two words—statistically significant—are bandied about with such abandon that they are quickly losing their meaning. Even people who should know better (the data wonks at Google Surveys should know better, right?) are saying ridiculous things…
If there is one thing I hope you remember from your college statistics class, it’s this: Correlation does not imply causation. This is especially important to remember in our world of big data. Any large dataset will have hundreds of thousands of correlations, but most of those correlations will reflect purely random occurrences that mean…
Data wonks have more fun than you may think. If you have not yet begun working with the R statistical program (which is mesmerizing, extremely powerful, hard to learn, but weirdly intuitive, and FREE) then here is a fun and relatively easy way to give it a test drive. It is becoming a tradition that,…
A favorite pastime in my household is to laugh at the absurd statistics our local weatherman conjures up to make his reports sound dramatic, scientific, and driven by a deep analysis of data. Things like, “These are the first three consecutive days since 1989 of 90+ degree temperatures following an immediately preceding four-week string of…
Last year, Gartner, which charts new trends and emerging technologies via its “Hype Cycle” tracking, decided to abandon its tracking of Big Data. The reason? Big data, they said, has become so ubiquitous and embedded in so many other technologies, that it is no longer a thing of its own. And yet, how many of…
The hottest new job title invading the world of market research is “data scientist.” It has many of us starting to wonder, aren’t we all data scientists? Whether quantitative or qualitative, we spend most of our time collecting, manipulating, interpreting, and presenting data. Our methods are grounded in social science. Put the two together and…
Whenever I write a research report, I feel strongly ambivalent about flagging data as “statistically significant.” If possible, I try to avoid it altogether. Why? Because p-values and concepts of statistical significance are often misunderstood, misused, and misleading. Indeed, the problem is so prevalent that one well-respected scientific journal in social psychology (Basic and Applied…
Every professional in market research should know about and use the amazing, public, free data resources provided by the U.S. government—data that includes essential information about our demographics, communities, businesses, commerce, roads, health, education…the list goes on. Now, a small group of consultants, data scientists, and programmers are trying to make that easier with a…
Every year I read the university catalogues for summer coursework in research methods and share a few recommendations with colleagues and clients. If you are looking for more than just the information and inspiration you get from conferences, look to the substance and depth you can get from a classroom. It’s easier than you might…
There is nothing worse than presenting research findings to an audience predisposed to hate it. Maybe you’ve had that experience of being in a boardroom of hostile managers? They don’t like what you’re about to say, so they pick at every methodological decision, shifting focus away from the story that the data have to tell.…