For some reason, nearly everybody in research believes that holidays are a bad time to ask people if they will participate in research. I am reminded of this because at Versta Research we have some big studies that launched just before Thanksgiving, and we have some big ones coming up just before and during the…
Extremely careful researchers work hard to make sure their surveys reach broad and representative samples of their target populations. This usually involves multiple attempts to reach out via multiple phone calls, e-mails, or letters of request. Since statistical models of inference presume 100% response rates within random samples, the goal is always to get response…
Believe it or not, there are still plenty of phone surveys being done out there, especially for local needs assessments and evaluation surveys. Often these surveys are mandated by state or local governments to ensure that the right services are reaching people who need them. But phone surveys are extremely difficult to field anymore, as…
Surveys run the gamut from silly to serious, and from sloppy to scientific. Occasionally we do something silly if a client insists (though we generally advise against it). But we never do sloppy surveys, and we hope you never do them either. Lean as far as possible towards rigor and science within reasonable constraints of…
There is a “user-friendly” feature that some survey platforms now offer, and almost certainly you should avoid it. It is called auto-advance. I had an unpleasant encounter with it in a customer survey I just took. The idea is that, after clicking on an answer, instead of having to move a mouse or finger all…
If you worry that cell phones make it harder to get high quality, thoughtful, and richly detailed data with surveys, stop worrying. New research from a trio of survey measurement scientists (one at the Census Bureau and two at University of Michigan’s Survey Research Center) shows there are no differences in data quality and measurement…
When college students get all worked up about inappropriate uses of email for campus electioneering, it is worth paying attention. Why? Because they are the next generation of consumers (and business decision makers) who will get our requests to participate in surveys. If we do it wrong, they will hit back, and they will be…
I used to think that when potential research respondents said no they’re not interested in participating in our survey, they really meant it, end of story. Then I started working more on the field side where all kinds of different data collection was happening all the time. Seeing recruitment and data collection up close amazed…
You might think that writing a feature article about liars, cheaters, and trolls in online surveys means we have a pretty damning view of online polls as a method of research. Not so. We are all in when it comes to online polling, and in fact it comprises the majority of the survey research we…
This week one of our sample suppliers said “no” when we asked if we could re-contact respondents for a purpose other than our original request. Good thing I asked, and you know what? I’m glad they said no. I want suppliers to think carefully about seemingly simple requests, and to point out ways in which…