Polling and phone technologies may finally have reached the point where mobile phones are no longer a threat to phone-based surveys, but a superior alternative. Only half (52%) of U.S. households now have a landline telephone. In contrast, more than nine out of ten adults have a mobile phone. And the latest findings from Pew…
Nine out of ten Americans (89%) regularly use the Internet. So the old argument that online surveys will miss big chunks of the U.S. population is no longer valid. But an important question remains: Are the remaining one in ten (11%) who are beyond reach with online surveys substantially different from the others? And if…
Actually, Joe Citizen does not love them, but Joe Researcher does. The horse-race polls for media release offer little value to the first Joe because the only poll that really matters is the election itself. But for Joe Researcher, political polls offer unparalleled, ongoing opportunities to understand, validate, and improve our methods of survey research.…
There are good reasons to avoid phone surveys if you can. But if there is no alternative, it is critical to think about strategies for integrating cell phones into your outreach and sampling. Almost half (48%) of U.S. adults have no landline telephone service, while fewer than one in ten (9%) have no cell phone…
Having jumped back into the 1,016-page Reference Manual on Scientific Evidence from the Federal Judicial Center and the National Research Council (see last week’s article on Defending Your Statistics in Court), I keep finding fascinating nuggets of information worth sharing with our marketing and research colleagues of all stripes. Consider this snippet from the section…
I resist the idea of using Twitter for research because I do not know anyone beyond journalists, PR people, and marketing folks who actually use Twitter. Well, that’s a terrible reason to dismiss a potentially rich source of data, especially because one premise of survey research is that small parts can represent the whole. My…
I recently came across this strange big book, the Reference Manual on Scientific Evidence, compiled by the Federal Judicial Center and the National Research Council. It’s not fun reading, but it provides an enormously useful and fascinating overview of what makes social and marketing research (and other kinds of scientific research, too) sufficiently rigorous to…
The next time you analyze the results of your customer satisfaction or brand loyalty tracking study, and you notice an upward or downward shift, ask yourself this: Is it reasonable to think that certain customers—either the happy ones or the unhappy ones—were more willing to give you their opinions than the other group? If so,…
Telephones used to be an awesome way to find a random sample of Americans. Nearly all Americans had a home telephone, nearly everybody would answer if you called, and most were willing to answer survey questions to help researchers understand public opinion. In fact, telephones have been so central to scientific survey research that the…
Over the last few years it has become clear that random digit dial telephone surveys—once the gold standard of survey research—are no longer so golden. But the New York Times has been a holdout among media giants, refusing to use online polls or to report findings from them. They have clung to the false idea…