For some reason I’m always a little surprised that people tell the truth on surveys. I like to think of my “healthy skepticism” as a professional asset, because it forces us to check and double check, corroborate and triangulate. Before we commit to the findings of a research effort, we need to feel 100% sure…
Market researchers complain a lot when they get data back from surveys and see that people have been “speeding” through their surveys or that people are not giving thoughtful responses. Putting aside the issue of fraud (which is a huge problem in our industry) the problem is rarely “bad respondents” – instead the problem is…
In an essay published not too long ago, Stuart Rothenberg, a prominent political (and non-partisan) commentator argued that partisan pollsters (those who work directly for either Democratic or Republican candidates) do a better job than presumably objective third party pollsters. Why? Because they have to get it right. Their campaign strategies depend on it. Quoting…
Here are four types of “attention checks” to build into your questionnaires and analysis in order to assess whether respondents are fully engaged in answering your survey.
Cell phone dialing is now essential for phone surveys, just as mobile-optimized surveys are essential for online surveys. A lot of market research continues to ignore this.
It’s not easy to use a survey to measure public knowledge or misperceptions. Why? Because surveys are not quizzes. Respondents expect you to ask questions they can answer truthfully and correctly based on their opinions and experience. As good researchers, we mostly try to reassure respondents: “There are no right or wrong answers! Please give…
An endearing trait of survey respondents is that most are sincerely interested in helping you. They want to offer authentic opinions. They want to provide you with good data. I was reminded of this when reading findings from a study about survey “cheating” in a recent issue of Public Opinion Quarterly. The researchers (at the…
The COVID-19 pandemic decimated the research industry’s respondent panels, and here’s the impact it is having on our (and your) research today. All of a sudden, research came to a halt in early 2020. Clients wanted their fieldwork put on hold for six months or more. Panel companies stopped investing in and nurturing their panels.…
If you suffer from miserably low response rates to surveys you send with your own e-mail list, here’s something to try: Dump the e-mail invitation functionality that is built into your survey platform like Qualtrics. Instead, use a stand-alone email tool like Mail Chimp or Constant Contact. This will make your life harder, and it…
Versta Research is presenting this week at the 76th annual conference of the American Association for Public Opinion Research (AAPOR). The conference is being held virtually from May 11 to 14, 2021. The presentation is called Finding Fraud in Public Polls: Employing Semantic Network-Based Methods for Identifying Fraud in Online Sampling. It is a reflection…