How Human-in-the-Loop AI is Like House Hunters
Struggling to explain AI? Try this before|after strategy.
House Hunters International is great guilty-pleasure viewing, especially while nursing a cold or avoiding the plague. (Pro: Insider views of interesting cities. Con: Reminders of the unique pain of choosing a place to live.) It’s easy to add city center, natural light, and extra bedrooms to your wish list, but painful to accept the inevitable […]
Can we explain AI with experiential? I say yes.
To cut through AI complexity, focus on decisions. Never has it been more important to effectively explain complex concepts. Technology is influencing most decision processes, not always transparently so. On the bumpy road toward explainable AI (XAI), we find great communication options, from printed materials to state-of-the-art experiences. But where do you start, or know […]
What we talk about when we talk about deciding: Notes from DAAG 2019
I’ll be at VentureBeat’s Transform AI conference July 10-11 in San Francisco. Let me know if you’re attending; would be great to meet. -Tracy It’s not always easy staying on the AI bandwagon. Claims of algorithmic bias abound and (mis)applications threaten people’s trust. Not everyone wants their face recognized or their driver’s license scanned. Developers […]
Our #1 fear: Withering under scrutiny.
Since my work is about humans+AI deciding together, I attended DAAG 2019 in beautiful downtown Denver, exploring the “intersection of decision analysis and data science to take decision-making to the next level.” The intent was for decision analysts to better understand data science and “support data-centric decision-making” while data scientists could better “guide the use […]
Don’t build a data department store.
Jerry Seinfeld was wrong when he claimed public speaking is our #1 fear. I’m pretty sure we’re more afraid of having our decisions scrutinized. Adding to the fun, now algorithmic decisions are under pressure too. It is rather painful to have decisions second-guessed before the numbers come in, and even worse if things go pear-shaped. […]
Are you quantamental? Should you be?
To paraphrase Raymond Chandler, too many projects deliver department store data: The most of everything but the best of nothing. Enterprise AI and analytics developers must avoid the mistake of underserving people by overengineering solutions. Designers and decision makers need straightforward tools to make them better, to save time and facilitate their best work. They […]
Evaluate your decision process separately from your outcomes.
Quantamental is an investment strategy combining quantitative and fundamental methods. Data and algorithms have “prompted many traditional fundamentals-centered discretionary funds to integrate data-driven tools in day-to-day decision-making.” MarketWatch says the quantamental merger of computing power and human expertise is investing’s next frontier. Example: Active trading based on a particular blend of conventional balance sheets and […]
What makes us trust analytics, and how to argue.
How we decide is no less important than the data we use to decide. People are recognizing this and creating innovative ways to blend what, why, and how into decision processes. 1. Apply behavioral science → Less cognitive bias McKinsey experts offer excellent insight into Behavioral science in business: Nudging, debiasing, and managing the irrational […]
Weaponizing KPIs and debiasing decision algorithms.
1. Prior experience → More trust In Trustworthy Data Analysis, Roger Peng gives an elegant description of how he evaluates analytics presentations, and what factors influence his trust level. First, he imagines analytical work in three buckets: A (the material presented), B (work done but not presented), and C (analytical work not done). “We can […]
1. Vigilance → Better algorithms “Eliminating bias… requires constant vigilance on the part of not only data scientists but up and down the corporate ranks.” In an insightful Information Week commentary, James Kobielus (@jameskobielus) considers the importance of Debiasing Our Statistical Algorithms Down to Their Roots. “Rest assured that AI, machine learning, and other statistical […]