At first I thought this was the dumbest survey question ever. Why ask people what device they are using to take the survey, when you know from the platform meta-data what device they are using? Yes, even lame self-service survey platforms can (and should be) capturing information about device, operating system, IP address, start time,…
It bugs me that companies would use customer feedback surveys not for information or learning, but to manipulate customers into buying from them again. On the other hand, how many companies inundate us with those zillions of customer satisfaction surveys because they truly care about learning? What they really care about are their “metrics,” their…
It all depends on what counts as a “question,” and also on how complex those questions are. A grid question with multiple rows takes a longer to answer than a simple yes-or-no question. A question that allows you to select multiple items from a laundry list of options takes longer than a standard 4-point scale.…
I have been surprised by the number of people—including friends and even veteran researchers within the market research industry—who believe that the outcome of the 2016 presidential election proved once and for all that surveys and polling do not work. Why am I surprised? Because it is simply not true. In the Versta Research Winter…
Almost certainly more than you think. If you are purchasing access to survey respondents from panel providers, or from survey software providers, or from any other source beyond your own list (and even then, how carefully are you controlling access to your survey?) you are probably getting fraudulent data from automated bots or from survey-taker…
Data wonks have more fun than you may think. If you have not yet begun working with the R statistical program (which is mesmerizing, extremely powerful, hard to learn, but weirdly intuitive, and FREE) then here is a fun and relatively easy way to give it a test drive. It is becoming a tradition that,…
Using surveys to “quiz” people about their knowledge (versus asking them about their attitudes or behaviors) is tricky. First, online surveys make it easy for people to look up answers they may not otherwise know. Second, people want to get quiz answers right, and so they are motivated to cheat. This is the reason I…
The R statistical package is an amazingly powerful and versatile tool for data analysis and data visualization. When it comes to graphics and charts, here is one reason: It has foundational plotting tools that can be adapted in infinitely many ways to create (and invent) many more types of charts than you will find in…
Sometimes data visualization is too compelling for it’s own good. People are impressed by the beautiful design, and they look right past the utter nonsense being presented. This is “beautifully” illustrated by Google’s rollout of the first of many new features of their survey tool. Here’s the email they sent: We’re excited to announce that…
A surprising trend among our academic colleagues in marketing, psychology, and the social and behavioral sciences, is that they are crowdsourcing respondents for research studies from Mechanical Turk (MTurk). I am still overcoming my own resistance to the idea, as it rubs against Versta Research’s obsessive focus on data quality. Online sampling absolutely can and…