It all depends on what counts as a “question,” and also on how complex those questions are. A grid question with multiple rows takes a longer to answer than a simple yes-or-no question. A question that allows you to select multiple items from a laundry list of options takes longer than a standard 4-point scale.…
Almost certainly more than you think. If you are purchasing access to survey respondents from panel providers, or from survey software providers, or from any other source beyond your own list (and even then, how carefully are you controlling access to your survey?) you are probably getting fraudulent data from automated bots or from survey-taker…
A surprising trend among our academic colleagues in marketing, psychology, and the social and behavioral sciences, is that they are crowdsourcing respondents for research studies from Mechanical Turk (MTurk). I am still overcoming my own resistance to the idea, as it rubs against Versta Research’s obsessive focus on data quality. Online sampling absolutely can and…
Even just a few years ago the idea of using SMS text messaging for surveys seemed absurd. There were strong demographic skews to cell phone usage, and among SMS usage as well. Texting was often a cost add-on for cell phone users, so they carefully guarded it. And of course research companies could barely manage…
Most companies test new product or service ideas with concept tests to evaluate market interest and to refine their ideas. Most of these (like most surveys, nowadays) are conducted online, which offers speed and cost efficiency. But there is a downside. While people are quite adept at reviewing ideas and answering questions in online formats,…
Here we are on Global Accessibility Awareness Day, which makes it a perfect time to answer the question: “What in the world do we mean by accessible surveys?” Our last newsletter (How to Make a Survey ADA Accessible) outlined the important steps needed to begin developing such surveys. But it’s worth stepping back from the…
Nine out of ten Americans (89%) regularly use the Internet. So the old argument that online surveys will miss big chunks of the U.S. population is no longer valid. But an important question remains: Are the remaining one in ten (11%) who are beyond reach with online surveys substantially different from the others? And if…
If you are a consumer-facing company deploying online surveys of your customers, accessible surveys will likely be on your agenda in the next couple of years. Accessible surveys incorporate unique design features so that people with disabilities who use assistive technologies can participate as fully as others. With the need for survey accessibility growing and…
For all the high level intellectual work you do in research (statistical work, design work, analysis, or writing) there is just as much brute force effort you need to put into fieldwork. That means finding the people to interview, convincing them to participate, asking them questions, and recording their answers. Even if you outsource, keeping…
Some respondents answer survey questions with the same answer over and over again. They agree to everything, or they give identical numeric ratings to all items. It’s called “straight-lining,” and we often consider this a sign of poor data quality. I was intrigued by an approach to mitigating the problem I learned last week, shared…