Magical thinking about ev-gen, your TA is a bot, and Foursquare predicts stuff really well.
Getting to evidence-based policy: Explainista, Randomista, or Mapista?
1. Magical thinking about ev-gen. Rachel E. Sherman, M.D., M.P.H., and Robert M. Califf, M.D. of the US FDA have described what is needed to develop an evidence generation system – and must be playing a really long game. “The result? Researchers will be able to distill the data into actionable evidence that can ultimately […]
Masters of self-deception, rapid systematic reviews, and Gauss v. Legendre.
Three Ways of Getting to Evidence-Based Policy. In the Stanford Social Innovation Review, Bernadette Wright (@MeaningflEvdenc) does a nice job of describing three ideologies for gathering evidence to inform policy. Randomista: Views randomized experiments and quasi-experimental research designs as the only reliable evidence for choosing programs. Explainista: Believes useful evidence needs to provide trustworthy data […]
Analytics of presentations, Game of Thrones graph theory, and decision quality.
1. Human fallibility → Debiasing techniques → Better science Don’t miss Regina Nuzzo’s fantastic analysis in Nature: How scientists trick themselves, and how they can stop. @ReginaNuzzo explains why people are masters of self-deception, and how cognitive biases interfere with rigorous findings. Making things worse are a flawed science publishing process and “performance enhancing” statistical […]
NBA heat maps, FICO vs Facebook, and peer review.
1. Edges, dragons, and imps. Network analysis reveals that Tyrion is the true protagonist of Game of Thrones. Fans already knew, but it’s cool that the graph confirms it. This Math Horizons article is a nice introduction to graph theory: edges, betweeness, and other concepts. 2. Teach your team to make high-quality decisions. Few of […]
‘Evidence-based’ is a thing. It was a very good year.
1. Resistance is futile. You must watch Steph Curry. The Golden State Warriors grow more irresistible every year, in large part because of Curry’s shooting. With sports data analytics from Basketball-Reference.com, these heat maps illustrate his shift to 3-pointers (and leave no doubt why Curry was called the Babyfaced Assassin; now of course he’s simply […]
2015 was kind to the ‘evidence-based’ movement. Leaders in important sectors – ranging from healthcare to education policy – are adopting standardized, rigorous methods for data gathering, analytics, and decision making. Evaluation of interventions will never be the same. With so much data available, it’s a non-stop effort to pinpoint which sources possess the validity, […]