Progress bars that show respondents how far along they are in a survey have become standard in our industry. But are progress bars a documented “best practice” for survey research, or just another convention? A recent article in the Social Science Computer Review offers a meta-analysis of 32 field experiments designed to see whether progress…
It might seem that turning data into stories happens entirely at the back end of research when data are analyzed and insights are synthesized into reports. Not so. It requires careful thought at every step from the very beginning (during design) to the very end (during fact-checking). The entire data collection process is no exception. …
As we get further along in our careers most of us get further away from the nitty-gritty of data collection, data coding, and sometimes even data analysis. But I always feel nervous about that distance, and usually want to take a quick scan through the raw data myself. I want to see all those rows…
When customers talk about wanting faster and cheaper research, we’ve learned they’re not clamoring for all research to be faster and cheaper than ever before. Rather, they’re looking for new methods and niche solutions that fit specific problems they face. The distinction is crucial, because the first pushes us to automate, routinize, outsource, and make…
Versta Research’s winter newsletter comes out next week, which will focus on some new approaches to faster (and cheaper) market research. In the meantime we have been thinking a good deal about where to invest in new methods and innovation during the coming year so that we continue to make our work better and smarter…
We ran this script of a Christmas Eve phone survey interview two years ago. It’s time to bring it out again! It’s an amusing and oh-too-true parody of how market research pollsters ask questions in clear, precise, linear ways to gather data we need for analysis. Although it takes the form of a phone interview…
One way to get more people responding to your survey is to let them know ahead of time that the survey is coming their way. Is one method of outreach better than another? It depends on your audience and the type of survey, but several studies over the last decade have shown a consistent difference…
The Associated Press (AP) announced last month it is moving all of its public opinion polling from phone surveys to online surveys. This is progress, because over the last decade AP has been one of a handful of media holdouts (along with ABC News and The New York Times) who have insisted that only phone-based…
The purists in the polling industry who have always insisted that only probability sampling is valid may finally be accepting that their methods are dead. This is one happy conclusion I draw from the debate over AAPOR’s recent task force report on non-probability sampling, which is nicely summarized (and debated) as the lead article of…
This picture sits on my bookshelf, right next to my computer monitor, and reminds me all day long about the importance of getting close to your data. It was one of my first research jobs out of college, working for Tom Greene at St. Lawrence University. We hiked up mountains in the Adirondacks, waited at…