Category Archives: Statistical Thinking Series

Good psychics have a knack for getting their audience to reveal, unwittingly, information that can be turned around and used in a prediction.  Statisticians and data scientists fall prey to a related phenomenon, leakage, when they allow into their models highly predictive features that would be unavailable at prediction time.  In one noted example, aContinue reading “Controlling Leaks”

As the popularity of data science has grown, so too has advice on how to get jobs in data science.  A common form of advice is a list of sample questions you might be asked at your job interview (see here and here for examples).  Often, the list starts out with statistics, but beware: itContinue reading “As an Aspiring Data Scientist, What Do I Really Need to Know About Statistics?”