I became curious last week about what happened to those research people charged with fraud last year for selling fake panelists to complete market research surveys. One by one they are pleading guilty. But there was something much more interesting for me than learning about their guilty pleas. It was the “thought experiment” it provoked…
I submitted a letter to The New Yorker about some statistics they published regarding prenuptial agreements. The numbers were obviously suspicious and most likely incorrect. They chose not to print my letter, though I believe it is worth printing here because it highlights the power of dramatic, plausible numbers and the importance of taking a…
Choosing an omnibus survey can be a simple approach to getting survey data, because it is usually inexpensive and fast, and involves asking just a few questions. But there is sometimes a downside to simplicity: You have just a few questions to get that nugget of data you’re hoping to use as a news hook…
Silly surveys, in all their forms, have long been a thorn in the side of authentic, truth-seeking research. When I see silly surveys, I roll my eyes and complain (to anyone who will listen) about the myriad ways in which they subtly damage the reputation and findings of good research. But here is an example…
Election season polling always highlights the danger of bad pollsters giving the market research and polling industry a bad name. While there are lots of reasons that polls might predict outcomes incorrectly (polling is far more difficult and risky than many people think) there is no excuse for deliberately bad pollsters making up data to…
In an article published some years ago entitled Data-Driven Journalism, Walker Sands, a Chicago-based marketing and PR agency, outlined two ways to get media placement for your company or your client with research. Their premise was that journalists and readers are hungry for interesting stories, and in today’s data-driven world, some of the most interesting…
Market researchers complain a lot when they get data back from surveys and see that people have been “speeding” through their surveys or that people are not giving thoughtful responses. Putting aside the issue of fraud (which is a huge problem in our industry) the problem is rarely “bad respondents” – instead the problem is…
Today I saw my first “dumb election statistics” article of the season, with AP News offering this dramatically titled story: Kamala Harris’ election would defy history. Just 1 sitting VP has been elected president since 1836. We are bound to see tons of headlines and stories like this during the next several weeks. It brought…
In an essay published not too long ago, Stuart Rothenberg, a prominent political (and non-partisan) commentator argued that partisan pollsters (those who work directly for either Democratic or Republican candidates) do a better job than presumably objective third party pollsters. Why? Because they have to get it right. Their campaign strategies depend on it. Quoting…
On Monday I received media training from one of the research industry’s top professional organizations: The American Association for Public Opinion Research (AAPOR). They hired Brenda Foster, a career journalist and now a communications and PR consultant, to teach research nerds about how to succeed with media interviews when talking about research findings. First she…