Actually, Joe Citizen does not love them, but Joe Researcher does. The horse-race polls for media release offer little value to the first Joe because the only poll that really matters is the election itself. But for Joe Researcher, political polls offer unparalleled, ongoing opportunities to understand, validate, and improve our methods of survey research.…
There are good reasons to avoid phone surveys if you can. But if there is no alternative, it is critical to think about strategies for integrating cell phones into your outreach and sampling. Almost half (48%) of U.S. adults have no landline telephone service, while fewer than one in ten (9%) have no cell phone…
Having jumped back into the 1,016-page Reference Manual on Scientific Evidence from the Federal Judicial Center and the National Research Council (see last week’s article on Defending Your Statistics in Court), I keep finding fascinating nuggets of information worth sharing with our marketing and research colleagues of all stripes. Consider this snippet from the section…
I resist the idea of using Twitter for research because I do not know anyone beyond journalists, PR people, and marketing folks who actually use Twitter. Well, that’s a terrible reason to dismiss a potentially rich source of data, especially because one premise of survey research is that small parts can represent the whole. My…
I recently came across this strange big book, the Reference Manual on Scientific Evidence, compiled by the Federal Judicial Center and the National Research Council. It’s not fun reading, but it provides an enormously useful and fascinating overview of what makes social and marketing research (and other kinds of scientific research, too) sufficiently rigorous to…
The next time you analyze the results of your customer satisfaction or brand loyalty tracking study, and you notice an upward or downward shift, ask yourself this: Is it reasonable to think that certain customers—either the happy ones or the unhappy ones—were more willing to give you their opinions than the other group? If so,…
Telephones used to be an awesome way to find a random sample of Americans. Nearly all Americans had a home telephone, nearly everybody would answer if you called, and most were willing to answer survey questions to help researchers understand public opinion. In fact, telephones have been so central to scientific survey research that the…
Over the last few years it has become clear that random digit dial telephone surveys—once the gold standard of survey research—are no longer so golden. But the New York Times has been a holdout among media giants, refusing to use online polls or to report findings from them. They have clung to the false idea…
Leading practitioners of survey research now agree that online polling and other forms of non-probability sampling can work. The key is to give careful attention to the survey protocols, data collection, cleaning, and back-end weighting so that ultimately the sample being analyzed matches the population you want to know about in as many relevant ways…
Every year I enjoy getting an invitation to participate in Bon Appétit’s “most important survey of the year” because it provides so many good lessons for survey research. This year it has me thinking about the absurd e-mail subject line that says: “We need your help to get 100% participation.” Bon Appétit has 1,442,388 subscribers. …