Among the many sources of potential error that can affect surveys are respondents themselves. They sometimes misinterpret questions, respond in socially acceptable ways, or give “easy” answers in hopes that a more interesting question is just around the corner. This is not to say they are bad or fraudulent respondents. Research shows that the vast…
The latest data from the CDC’s National Health Interview Survey show that one quarter (25%) of U.S. adults do not have land-line telephones in their homes. So if you conduct a traditional random-digit-dial (RDD) phone survey, you will automatically be excluding one quarter of the population. Does it matter, given that surveys rarely interview everyone…
Despite having been on the front lines of social research for twenty five years, interviewing respondents personally and eliciting data through surveys, I still feel somewhat surprised and disbelieving that people really want to participate in research. But they do. Sometimes eagerly. Almost always truthfully. Surely, my surprise stems from my own reluctance to fill…
Does data displayed in charts and graphs, rather than tables, lead to better decisions? Not according to the latest research reported in this month’s Journal of Marketing Research. The authors looked at various types of biases that creep into business managers’ decisions when based on data presented to them. They did this by conducting experiments…
We are currently engaged in a research project for a client in South Korea, so issues of cross-cultural communication are top-of-mind for us right now. Whether we rely on translations, or whether we speak the same language as our clients and respondents, it is important for researchers to understand differences in how people think and…
Another article was just published in the Spring 2010 issue of Public Opinion Quarterly exploring data quality differences between online surveys and phone surveys. The findings were based on a lab experiment in which subjects completed survey questions either on a computer or over an intercom system with an interviewer. Doing the study in a…
One problem with new survey technologies that make it easy (and inexpensive) to design and field surveys is that we now have an explosion of poorly done and ill-intentioned surveys. Have you ever suspected that a survey isn’t quite legit? Keeping your survey efforts honest is critical. Sincere efforts to document issues through rigorous surveys…
A research article the Winter 2009 issue of Public Opinion Quarterly provided some useful comparisons of data quality between phone surveys and various types of online surveys. The findings are based on an experiment that fielded identical questionnaires via three survey modes, and, not surprisingly, there are strengths and weaknesses to each type of survey.…
Bad pollsters give the market research industry a bad name, so it is encouraging when smart people figure out clever ways of ratting them out. What is a bad pollster? One who makes up data to support an agenda, or who asks biased questions to get preferred answers. The only good reason for doing research…
Mistakes to Avoid when Conducting a Public Relations Survey Surveys and polls can be powerful tools to understand what people are thinking and doing, and they can provide good data for public relations efforts and community outreach. Unfortunately they can also be gimmicks, which erodes trust in polling and in the organizations sponsoring them.