Our #1 fear: Withering under scrutiny.
Don’t build a data department store.
Jerry Seinfeld was wrong when he claimed public speaking is our #1 fear. I’m pretty sure we’re more afraid of having our decisions scrutinized. Adding to the fun, now algorithmic decisions are under pressure too. It is rather painful to have decisions second-guessed before the numbers come in, and even worse if things go pear-shaped. […]
Are you quantamental? Should you be?
To paraphrase Raymond Chandler, too many projects deliver department store data: The most of everything but the best of nothing. Enterprise AI and analytics developers must avoid the mistake of underserving people by overengineering solutions. Designers and decision makers need straightforward tools to make them better, to save time and facilitate their best work. They […]
Evaluate your decision process separately from your outcomes.
Quantamental is an investment strategy combining quantitative and fundamental methods. Data and algorithms have “prompted many traditional fundamentals-centered discretionary funds to integrate data-driven tools in day-to-day decision-making.” MarketWatch says the quantamental merger of computing power and human expertise is investing’s next frontier. Example: Active trading based on a particular blend of conventional balance sheets and […]
What makes us trust analytics, and how to argue.
How we decide is no less important than the data we use to decide. People are recognizing this and creating innovative ways to blend what, why, and how into decision processes. 1. Apply behavioral science → Less cognitive bias McKinsey experts offer excellent insight into Behavioral science in business: Nudging, debiasing, and managing the irrational […]
Weaponizing KPIs and debiasing decision algorithms.
1. Prior experience → More trust In Trustworthy Data Analysis, Roger Peng gives an elegant description of how he evaluates analytics presentations, and what factors influence his trust level. First, he imagines analytical work in three buckets: A (the material presented), B (work done but not presented), and C (analytical work not done). “We can […]
Debiasing is painful, why analytics fail, and health app evidence.
1. Vigilance → Better algorithms “Eliminating bias… requires constant vigilance on the part of not only data scientists but up and down the corporate ranks.” In an insightful Information Week commentary, James Kobielus (@jameskobielus) considers the importance of Debiasing Our Statistical Algorithms Down to Their Roots. “Rest assured that AI, machine learning, and other statistical […]
Success theater, leaky tech pipeline, teacher bias, network meta-analysis.
1. Debiasing → Better decisions Debiasing is hard work, requiring honest communication and occasional stomach upset. But it gets easier and can become a habit, especially if people have a systematic way of checking their decisions for bias. In this podcast and interview transcript, Nobel-winning Richard Thaler explains several practical ways to debias decisions. First, […]
Redefining data science skill, biased policy decisions, and data strategy.
1. Biased instructor response → Students shut out Definitely not awesome. Stanford’s Center for Education Policy Analysis reports Bias in Online Classes: Evidence from a Field Experiment. “We find that instructors are 94% more likely to respond to forum posts by white male students. In contrast, we do not find general evidence of biases in […]
Machines Gone Wild! + Can Microlearning improve Data Science training?
1. Biased analysis → Misunderstood cause-effect In Biased Ways We Look at Poverty, Adam Ozimek reviews new evidence suggesting that food deserts aren’t the problem, behavior is. His Modeled Behavior (Forbes) piece asks why the food desert theory got so much play, claiming “I would argue it reflects liberal bias when it comes to understanding […]
1. Machines Gone Wild → Digital trust gap Last year I spoke with the CEO of a smallish healthcare firm. He had not embraced sophisticated analytics or machine-made decision making, with no comfort level for ‘what information he could believe’. He did, however, trust the CFO’s recommendations. Evidently, these sentiments are widely shared. — […]