How many people do you think are college-educated in the United States? If you’re like most clients we work for (whose family members, friends and co-workers nearly all have college degrees) you will substantially over-estimate that number. The answer is a mere 29%. If you include associate’s degrees, then it goes up to 37%. These…
You might think that writing a feature article about liars, cheaters, and trolls in online surveys means we have a pretty damning view of online polls as a method of research. Not so. We are all in when it comes to online polling, and in fact it comprises the majority of the survey research we…
Sure we laugh at those ridiculously biased fundraising “surveys” from politicians. But for some reason, the poorly (but more cleverly) designed surveys put out by corporate PR departments often get a pass. Even worse, they sometimes get tons of visibility in both mainstream press and social media. I saw one such survey a few weeks…
Here is an update on what went wrong with the Clinton vs. Trump polling debacle last fall, according to AAPOR’s official Evaluation of 2016 Election Polls in the U.S. that was released several weeks ago. The conclusions are based on an analysis and assessment of publicly available polling data plus additional data supplied by top…
If you conduct a well-designed, well-executed survey of 500 people you probably think (and yes, we may have told you) that your margin of error is ±4%. It’s beautiful. It’s all based on math. And if you ever had that “aha” moment in statistics class, you probably agree that the mathematical proof of it is…
I’ve been reading through a report from the AAPOR Task Force on The Future of U.S. General Population Telephone Survey Research, which I thought might be interesting and provocative, given how oddly reluctant the organization has been to embrace online methods. Only a few years ago AAPOR (the American Association of Public Opinion Research) finally…
Bad surveys bug me. Bad surveys touted in The New York Times bug me even more, as I expect only the best from them. Bad surveys on the front page of The New York Times with ridiculous and sensationalist findings bug me so much that they inspire blog posts. A front page article on July…
Research for PR is definitely not “research lite” as my former boss used to think. It is the opposite, and requires more attention to rigor than strategic research. Why? Because no other research gets such intense scrutiny from people outside our firm and from audiences beyond our clients. It can’t be “directional.” It has to…
Just back from LIMRA’s 2017 Marketing and Research Conference, I am happy to report a successful and productive “meeting of the minds” from both the Marketing Side and the Research Side of this uniquely blended gathering of financial services professionals. No matter what some may say, research is not part and parcel of marketing. Nor…
It was so weird, right after the election, to see a media frenzy heaping praise and attention on the one poll that got it wrong. The USC/LA Times poll predicted a Trump win, with 47% of voters choosing Trump and 44% choosing Clinton. Right after the election, media headlines trumpeted its success: “How One Pollster…