A simple technique that will measurably improve your data quality is to offer survey response options that go from low to high, or from bad to good. Start with things like terrible, zero, poor, disagree, and so on. Then move towards spectacular, excellent, ten, and agree.
Yesterday we were in Milwaukee at a film studio, shooting for a soon-to-be-released Versta Research video about making research matter. It explains how to design and execute research to ensure that it gets heard, understood, and put into action by your business partners. The video outlines three tips. Here’s the first: begin by writing dream…
Just one month after publishing our Quick Puzzle for Market Research Brains (SPOILER ALERT! If you have not tried the puzzle yourself, do it now before continuing to read!) which demonstrated the dangers of confirmation bias, I read a report from the National Science Foundation (NSF), released in May, that warned of the same thing.…
Leave it to the National Science Foundation to keep me hip on current research lingo. A report published last May (with the very unhip title Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science) offered this definition of an edgy new term in research called p-hacking: Generating many different sets of results and…
I am the Internet user that advertisers dread. I block as much advertising, video, flash content, and java script as I possibly can so that I stay focused on work without all that annoying, flashing, moving stuff trying to grab my attention. This always makes me wonder: Am I the Internet user that market researchers…
Here is a brilliant thought experiment about big data, published as a one-paragraph short story in 1946 by the Argentinian writer Jorge Luis Borges: “. . . In that Empire, the Art of Cartography attained such Perfection that the map of a single Province occupied the entirety of a City, and the map of the…
We have just published the Versta Research Fall 2015 Newsletter, offering an interactive puzzle to test your analytical skills as a research brain. It is based on a fascinating study published half a century ago in The Quarterly Journal of Experimental Psychology. When I first encountered the puzzle it stuck in my mind for quite…
If ever there were evidence that phone surveys are dead, it’s this: Gallup, the undisputed king of telephone polling for decades, has withdrawn from the race. The firm announced last week that it will not conduct candidate polling for the 2016 presidential election. This comes after the miserable failure of its polling in 2012, which…
Difficult or lengthy surveys require hefty incentives, which unfortunately makes it tempting for some respondents to lie. We are facing this predicament in a survey right now. The survey requires two people from the same household who share household finances to complete parallel surveys. We are recruiting from an online research panel. Person 1 gets…
For every research rule or best practice I proclaim, I find myself doing the opposite eventually. Such is the case with pie charts. I try to avoid them, taking to heart Edward Tufte’s claim that they are dumb and should never be used. Studies show that pie charts do a poor job helping readers grasp…