If ever there were evidence that phone surveys are dead, it’s this: Gallup, the undisputed king of telephone polling for decades, has withdrawn from the race. The firm announced last week that it will not conduct candidate polling for the 2016 presidential election. This comes after the miserable failure of its polling in 2012, which…
In the months leading up to this year’s Supreme Court ruling on marriage equality, Wells Fargo worked with Versta Research on a national survey of LGBT Americans. The goal was to understand how changes in marriage laws were affecting decisions about money and marriage. What did we learn about LGBT Americans? Here are two nuggets…
Two of my usually-favorite sources for information and insight (AAPOR and the New York Times) came together this week with an embarrassing, face-scrunching example of convoluted statistical reporting: But Internet use correlates inversely with age and voting habits, making [online polling] a more severe problem in predicting elections. While all but 3 percent of those…
Last month we were honored to be on the main stage at the Advertising Research Foundation’s Re:Think 2015 Conference, sharing with the nation’s top research and advertising executives insights from our work with Wells Fargo. I use the word honored for two reasons. First, we were selected from over 200 entries for one of the…
[SEE CARTOON] Of course those 99% keep reading the pointless polls, and most research firms are happy to keep generating pointless polls. The problem? Too few research firms are willing and able to help clients differentiate a survey that is informative and truly worthy of print, versus one that is pointless. So how do you…
Telephones used to be an awesome way to find a random sample of Americans. Nearly all Americans had a home telephone, nearly everybody would answer if you called, and most were willing to answer survey questions to help researchers understand public opinion. In fact, telephones have been so central to scientific survey research that the…
Over the last few years it has become clear that random digit dial telephone surveys—once the gold standard of survey research—are no longer so golden. But the New York Times has been a holdout among media giants, refusing to use online polls or to report findings from them. They have clung to the false idea…
One of the most useful techniques for in-depth qualitative interviewing is to ask respondents not only what they think, but what their friends, family, or colleagues think. It opens a whole new level of conversation and insight because all of the sudden respondents feel free to talk about their understanding and assessment of the world…
Readers of this newsletter and blog know how much we value and respect the New York Times. It is one of the few resources we cite regularly, as it always has relevant, authoritative information that informs our work and that of our clients. So my heart sank when I read this description of a new…
Question order in surveys matters a lot more than most of us realize, which makes it critical to assess what you most want to know before your survey respondents are influenced (or, in the language or survey experts, “primed”) by additional questions on the topic. Here is a superb example from last fall’s political polling…