You would think that the chancellor of a prestigious school like M.I.T.—a university that prides itself on practical applications of mathematics—would know something about how probabilities work with survey sampling. Apparently not. Quoting a New York Times article about M.I.T.’s survey of students about sexual assault on campus:
Readers of this newsletter and blog know how much we value and respect the New York Times. It is one of the few resources we cite regularly, as it always has relevant, authoritative information that informs our work and that of our clients. So my heart sank when I read this description of a new…
For the longest time I was puzzled by what it means to “over-fit” a model to one’s data. How can a model describe one’s data too perfectly? Aren’t we trying to get as close to a perfect fit as possible? This one-minute video will show you an example of over-fitting. After watching it, the odd…
Before the days of DATA MINING this was called DATA DREDGING. And for good reasons, because it was considered not a good thing. Almost any dataset will have nonsense correlations, and if you’ve turned on your magical statistical testing tool at the 95% confidence level, five out of every one hundred nonsense correlations will likely…
Leading practitioners of survey research now agree that online polling and other forms of non-probability sampling can work. The key is to give careful attention to the survey protocols, data collection, cleaning, and back-end weighting so that ultimately the sample being analyzed matches the population you want to know about in as many relevant ways…
Versta Research has just published is spring 2014 newsletter which features a short video on how to do pricing research. If you ever work with price and demand data, and need to figure out the optimal price for your product or service, here are two great tools worth knowing about: 1. PowerPoint (yes, that says…
I just read an online interview with Bob Muenchen, author of R for SAS and SPSS Users. He nicely describes an important aspect of R that I found to be one of the weirdest and most difficult to grasp, but once I “got it,” fell in love. Quoting at length:
I’m not sure if this cartoon is funny because I don’t really get it. But it was interesting enough that I started thinking about the null hypothesis, and what it means, and how statistics is changing so quickly that “the null hypothesis” we learned about in our classes may soon feel like an odd artifact…
Every year I offer my top picks for summer intensive training courses on research methods, and usually I point to several universities for the sake of options and a full range of methods. Well, this year I am pointing to just one. I looked at the course listings at the University of Michigan’s Survey Research…
A couple weeks ago we wrote about the crucial need to have (and ideally review) your raw data. We pointed to an article in the New York Times Magazine about a prominent professor in social psychology who faked his data and never provided the raw data for his colleagues and co-authors to review. What we…