Getting good responses to open-ended questions via online surveys is a challenge. So much so, that new technologies have evolved to probe on responses just as live interviewers used to probe people on phone surveys. But can you get really outstanding open-end responses to online surveys without fancy technology? The answer is yes, it just…
I recently came across this strange big book, the Reference Manual on Scientific Evidence, compiled by the Federal Judicial Center and the National Research Council. It’s not fun reading, but it provides an enormously useful and fascinating overview of what makes social and marketing research (and other kinds of scientific research, too) sufficiently rigorous to…
I used to get more worked up about survey answer scales than I do nowadays. I didn’t like even-numbered scales, including 1 to 10 scales (no midpoint!) or five point scales (too blunt!) or seven or nine point scales (not intuitive!). I liked zero to ten scales—and still do—because they offer good opportunity for respondent…
Question order in surveys matters a lot more than most of us realize, which makes it critical to assess what you most want to know before your survey respondents are influenced (or, in the language or survey experts, “primed”) by additional questions on the topic. Here is a superb example from last fall’s political polling…
Every year I offer my top picks for summer intensive training courses on research methods, and usually I point to several universities for the sake of options and a full range of methods. Well, this year I am pointing to just one. I looked at the course listings at the University of Michigan’s Survey Research…
If you have ever been called to participate in a phone survey, you probably know the routine where you hear a question and then jump in with an answer. A good interviewer will remind you that she needs to read the entire question and all the answer options just to be sure that you offered…
I was the kid who skipped recess to help grade quizzes; the graduate student who delayed getting a degree because it meant the end of school; the professor who told students that he was now in the 33rd grade and still loved school. Even now I can’t resist reviewing great opportunities for more coursework and…
It is good to use multiple survey questions to measure a particular attitude or opinion, and for many years experts on survey design recommended reversing the wording on some questions to get a stronger and more valid measure. For example, if we want to measure retirement confidence we might ask respondents how much they agree…
If you ever feel like strangling the next research consultant who promises to deliver “actionable insights” then you can join me and the Dilbert team in making fun of it instead. Not only is it a horrid phrase, but it is unfortunately meaningless now that every research firm claims to be different from others by…
Fifteen years ago the U.S. Census Bureau removed “Hispanic” from its question about race and instead created a stand-alone question to assess Hispanic ethnicity. It’s the reason we often advise our clients to ask about race and ethnicity separately, using questions similar to the Census Bureau’s, which are shown in Figure 1. Well, chances are…