For some reason I’m always a little surprised that people tell the truth on surveys. I like to think of my “healthy skepticism” as a professional asset, because it forces us to check and double check, corroborate and triangulate. Before we commit to the findings of a research effort, we need to feel 100% sure…
You might think that a research firm specializing in surveys would be glad to see a world in which customer feedback surveys are everywhere. Not so. I take part in a lot of webinars, and unfortunately I am asked to complete a survey (at least one) every time I attend. Some websites ask me to…
Market researchers complain a lot when they get data back from surveys and see that people have been “speeding” through their surveys or that people are not giving thoughtful responses. Putting aside the issue of fraud (which is a huge problem in our industry) the problem is rarely “bad respondents” – instead the problem is…
There are three important characteristics of people who “satisfice” on surveys: They are less conscientious They are less agreeable They have different cognitive skills The first two refer to dimensions of the Big Five personality traits. Conscientious people are efficient and organized vs. extravagant or careless. Agreeable people are friendly and compassionate vs. critical and…
Satisfice is not a word you will find in most dictionaries, but it is a word you will hear often in the world of survey research. Satisficing is what survey respondents do when they “sort of” want to answer survey questions but not really. They are like lazy students taking a test. They dislike too…
In an essay published not too long ago, Stuart Rothenberg, a prominent political (and non-partisan) commentator argued that partisan pollsters (those who work directly for either Democratic or Republican candidates) do a better job than presumably objective third party pollsters. Why? Because they have to get it right. Their campaign strategies depend on it. Quoting…
One of the weirdest new uses of artificial intelligence in market research is to create “synthetic respondents” for surveys and qualitative interviews. The idea is to use information scraped from the Internet via AI’s large language models, construct a sample of synthetic people that matches the demographics of one’s target population, and then ask those…
If you read our article a few years back ago about COVID-19, you may have noticed some statistics we cited that seemed odd and open to misinterpretation. That’s because instead of reporting the percentage of respondents who did or said something, we reported the mean of all survey respondents’ answers to a numeric scale. We…
Here are four types of “attention checks” to build into your questionnaires and analysis in order to assess whether respondents are fully engaged in answering your survey.
It might seem obvious that inattentive survey respondents should deleted from your data. Think again. Here’s why a “light touch” during data quality review is best.