Exploring Different Types of Survey Attention Checks
Here are four types of “attention checks” to build into your questionnaires and analysis in order to assess whether respondents are fully engaged in answering your survey.
Here are four types of “attention checks” to build into your questionnaires and analysis in order to assess whether respondents are fully engaged in answering your survey.
It might seem obvious that inattentive survey respondents should deleted from your data. Think again. Here’s why a “light touch” during data quality review is best.
It’s not easy to use a survey to measure public knowledge or misperceptions. Why? Because surveys are not quizzes. Respondents expect you to ask questions they can answer truthfully and correctly based on their opinions and experience. As good researchers, we mostly try to reassure respondents: “There are no right or wrong answers! Please give…
An endearing trait of survey respondents is that most are sincerely interested in helping you. They want to offer authentic opinions. They want to provide you with good data. I was reminded of this when reading findings from a study about survey “cheating” in a recent issue of Public Opinion Quarterly. The researchers (at the…
One refrain you will see on these pages throughout 2021 is that the time of cheap and easy online surveys is probably coming to a bitter, crashing end. Response rates are plummeting, even lower than we thought possible. Cheap online research panels (which are used for the vast majority of market research) are rife with…
The COVID-19 pandemic decimated the research industry’s respondent panels, and here’s the impact it is having on our (and your) research today. All of a sudden, research came to a halt in early 2020. Clients wanted their fieldwork put on hold for six months or more. Panel companies stopped investing in and nurturing their panels.…
Versta Research is presenting this week at the 76th annual conference of the American Association for Public Opinion Research (AAPOR). The conference is being held virtually from May 11 to 14, 2021. The presentation is called Finding Fraud in Public Polls: Employing Semantic Network-Based Methods for Identifying Fraud in Online Sampling. It is a reflection…
In our company we nearly always try to keep data collection “anonymous.” This means that for most of our surveys we intentionally do not know the identity of who participates (though our sample providers do). We rarely ask for any type of identifying information, not even a first name. If for some reason we have…
Let’s suppose that customers want to be surveyed. What is the best way to do it? Should we call them, send email, use text messaging, push surveys through mobile apps, or send old-fashioned paper surveys through the mail? This is a question we rarely ask in market research, because for most survey research we desperately…
The best way for you to get better survey data is to fix, optimize, and strategize your survey design. How? Abandon rote templates. Give up complexity. Think ahead to your analysis. Above all, put yourself in the shoes of a respondent. We market researchers complain when we get data back from surveys and see that…