Market researchers complain a lot when they get data back from surveys and see that people have been “speeding” through their surveys or that people are not giving thoughtful responses. Putting aside the issue of fraud (which is a huge problem in our industry) the problem is rarely “bad respondents” – instead the problem is…
There are three important characteristics of people who “satisfice” on surveys: They are less conscientious They are less agreeable They have different cognitive skills The first two refer to dimensions of the Big Five personality traits. Conscientious people are efficient and organized vs. extravagant or careless. Agreeable people are friendly and compassionate vs. critical and…
Satisfice is not a word you will find in most dictionaries, but it is a word you will hear often in the world of survey research. Satisficing is what survey respondents do when they “sort of” want to answer survey questions but not really. They are like lazy students taking a test. They dislike too…
One of the weirdest new uses of artificial intelligence in market research is to create “synthetic respondents” for surveys and qualitative interviews. The idea is to use information scraped from the Internet via AI’s large language models, construct a sample of synthetic people that matches the demographics of one’s target population, and then ask those…
Here are four types of “attention checks” to build into your questionnaires and analysis in order to assess whether respondents are fully engaged in answering your survey.
It might seem obvious that inattentive survey respondents should deleted from your data. Think again. Here’s why a “light touch” during data quality review is best.
It’s not easy to use a survey to measure public knowledge or misperceptions. Why? Because surveys are not quizzes. Respondents expect you to ask questions they can answer truthfully and correctly based on their opinions and experience. As good researchers, we mostly try to reassure respondents: “There are no right or wrong answers! Please give…
An endearing trait of survey respondents is that most are sincerely interested in helping you. They want to offer authentic opinions. They want to provide you with good data. I was reminded of this when reading findings from a study about survey “cheating” in a recent issue of Public Opinion Quarterly. The researchers (at the…
One refrain you will see on these pages throughout 2021 is that the time of cheap and easy online surveys is probably coming to a bitter, crashing end. Response rates are plummeting, even lower than we thought possible. Cheap online research panels (which are used for the vast majority of market research) are rife with…
The COVID-19 pandemic decimated the research industry’s respondent panels, and here’s the impact it is having on our (and your) research today. All of a sudden, research came to a halt in early 2020. Clients wanted their fieldwork put on hold for six months or more. Panel companies stopped investing in and nurturing their panels.…