Good psychics have a knack for getting their audience to reveal, unwittingly, information that can be turned around and used in a prediction. Statisticians and data scientists fall prey to a related phenomenon, leakage, when they allow into their models highly predictive features that would…
As the popularity of data science has grown, so too has advice on how to get jobs in data science. A common form of advice is a list of sample questions you might be asked at your job interview (see here and here for examples). …
In this week’s brief, a continuation of our “Statistical Thinking” series, we reflect on three “myths” in data science and statistics, and spotlight our ten-course Social Science Statistics certificate program. You can get started with either of these courses: Aug 7- Sep 4: Survey Design and…
Statistical Thinking 2: Safety in Numbers – Calculating Probabilities for Convoys Early 1942 was a critical period for the Allies in WWII. Russia was on its heels, with German armies at the gates of Moscow and preparing an offensive in southern Russia. Alone among the…
Statistical Thinking 1 Several years ago, an NPR reporter wanted a comment from me for his story about an unusual event: a woman had won a state lottery jackpot for a second time. Winning once was low enough odds, but winning twice? The reporter found…