Choosing an omnibus survey can be a simple approach to getting survey data, because it is usually inexpensive and fast, and involves asking just a few questions. But there is sometimes a downside to simplicity: You have just a few questions to get that nugget of data you’re hoping to use as a news hook…
Whenever we’re involved in global research work, issues of cross-cultural communication are top-of-mind. Whether we rely on translations, or whether we speak the same language as our clients and respondents, it is important for researchers to understand differences in how people think and respond to research questions because data is always context sensitive. For example,…
Asking people to fill out long, tiresome, and boring surveys is a scourge of the research, polling, and survey industry. (Another is asking them to fill out a survey every time they interact with you — see There Are Too Many Surveys.) Asking people to fill out long surveys teaches them to avoid surveys in…
Good research happens by design. That is one of the reasons we enjoy writing research proposals. Writing proposals is an exercise in research design, which is the place and time where you must think in strategic and smart ways about what you are going to do and how you are going to do it. You…
It should be straightforward to ask someone a simple factual question and receive a reliable answer. Questions like: “Do you have children?” “Do you attend church every week?” or “Do you own a bank account?” seem easy and clear-cut. However, the moment we begin drafting even these seemingly straightforward survey questions, we quickly uncover ambiguity…
When multiple surveys about the same topic give different results, consider yourself lucky. It provides an opportunity to dissect and understand the question you are trying to answer in a way you might not get otherwise. A New York Times article from several years ago provides a nice example when it comes to polls about…
Nearly every survey begins with screening questions to ensure that only the people you are trying to reach are included in the survey. For example, if you are conducting a survey of women, you need to ask about gender and kick out the men. And because every question costs money, you want to qualify respondents…
Market researchers complain a lot when they get data back from surveys and see that people have been “speeding” through their surveys or that people are not giving thoughtful responses. Putting aside the issue of fraud (which is a huge problem in our industry) the problem is rarely “bad respondents” – instead the problem is…
Satisfice is not a word you will find in most dictionaries, but it is a word you will hear often in the world of survey research. Satisficing is what survey respondents do when they “sort of” want to answer survey questions but not really. They are like lazy students taking a test. They dislike too…
If you read our article a few years back ago about COVID-19, you may have noticed some statistics we cited that seemed odd and open to misinterpretation. That’s because instead of reporting the percentage of respondents who did or said something, we reported the mean of all survey respondents’ answers to a numeric scale. We…