Election season polling always highlights the danger of bad pollsters giving the market research and polling industry a bad name. While there are lots of reasons that polls might predict outcomes incorrectly (polling is far more difficult and risky than many people think) there is no excuse for deliberately bad pollsters making up data to…
There are three important characteristics of people who “satisfice” on surveys: They are less conscientious They are less agreeable They have different cognitive skills The first two refer to dimensions of the Big Five personality traits. Conscientious people are efficient and organized vs. extravagant or careless. Agreeable people are friendly and compassionate vs. critical and…
Satisfice is not a word you will find in most dictionaries, but it is a word you will hear often in the world of survey research. Satisficing is what survey respondents do when they “sort of” want to answer survey questions but not really. They are like lazy students taking a test. They dislike too…
Here are four types of “attention checks” to build into your questionnaires and analysis in order to assess whether respondents are fully engaged in answering your survey.
It might seem obvious that inattentive survey respondents should deleted from your data. Think again. Here’s why a “light touch” during data quality review is best.
The New York Times’ recent brand and marketing campaign is all about Truth. Well, if Truth really matters, then they desperately need a good old fashioned survey to back their flimsy claims in a recent article about how small business owners view the candidates running for president. In a front-page article of the business section…
Believe it or not, some people do not find puppies irresistibly adorable, as our newest honorary member of the Versta Research team (pictured here) can tell you. Elio arrived a couple of weeks ago. He is 13 weeks old and truly over-the-top adorable. He mostly sleeps in a crate next to me as I work…
The online customer satisfaction survey I received today had me noticing an unfortunate side-effect of the NPS (Net Promoter Score) schema and visual imagery. For those of you unfamiliar with NPS as a way to measure and track customer satisfaction, here is how it goes. In your survey ask: “How likely are to recommend Acme…
Having focused intently over the last several months on best practices for writing surveys (see Five Last Steps in Writing a Questionnaire and How to Write Surveys: 25 Best Practices) I have been paying extra attention to the work of research methodologists who codify best practices and develop protocols for implementing them. One set of…
Extremely careful researchers work hard to make sure their surveys reach broad and representative samples of their target populations. This usually involves multiple attempts to reach out via multiple phone calls, e-mails, or letters of request. Since statistical models of inference presume 100% response rates within random samples, the goal is always to get response…