Almost certainly more than you think. If you are purchasing access to survey respondents from panel providers, or from survey software providers, or from any other source beyond your own list (and even then, how carefully are you controlling access to your survey?) you are probably getting fraudulent data from automated bots or from survey-taker…
Using surveys to “quiz” people about their knowledge (versus asking them about their attitudes or behaviors) is tricky. First, online surveys make it easy for people to look up answers they may not otherwise know. Second, people want to get quiz answers right, and so they are motivated to cheat. This is the reason I…
Sometimes data visualization is too compelling for it’s own good. People are impressed by the beautiful design, and they look right past the utter nonsense being presented. This is “beautifully” illustrated by Google’s rollout of the first of many new features of their survey tool. Here’s the email they sent: We’re excited to announce that…
The last presidential election was a stunning win for online polls and a drubbing defeat for telephone polls. It provoked a loud and contentious debate among survey methodologists about the accuracy of polls and about how (and whether) to revise our methods. So here we are again, four years later with technology having moved faster…
Even just a few years ago the idea of using SMS text messaging for surveys seemed absurd. There were strong demographic skews to cell phone usage, and among SMS usage as well. Texting was often a cost add-on for cell phone users, so they carefully guarded it. And of course research companies could barely manage…
There is an important directional bias in our culture such that things above tend to be perceived as better than things below. Top is better than bottom. Up is better than down. Over is better than under. Whatever the reasons for this bias (and there are several compelling theories) recent research shows that it affects…
That Nespresso survey I got via my work email—surely it must be SPAM, right? I have no relationship with the company and have never inquired about it. Some sleazy market research company harvested a huge list of e-mails and blasted it out to hundreds of thousands of people like me. So I decided to report…
Most companies test new product or service ideas with concept tests to evaluate market interest and to refine their ideas. Most of these (like most surveys, nowadays) are conducted online, which offers speed and cost efficiency. But there is a downside. While people are quite adept at reviewing ideas and answering questions in online formats,…
Here we are on Global Accessibility Awareness Day, which makes it a perfect time to answer the question: “What in the world do we mean by accessible surveys?” Our last newsletter (How to Make a Survey ADA Accessible) outlined the important steps needed to begin developing such surveys. But it’s worth stepping back from the…
Nine out of ten Americans (89%) regularly use the Internet. So the old argument that online surveys will miss big chunks of the U.S. population is no longer valid. But an important question remains: Are the remaining one in ten (11%) who are beyond reach with online surveys substantially different from the others? And if…