loader from loading.io

Make Better Decisions When Nothing is Certain

Killer Innovations with Phil McKinney

Release Date: 11/04/2025

Second-Order Thinking: How to Stop Your Decisions From Creating Bigger Problems (Thinking 101 - Ep 6) show art Second-Order Thinking: How to Stop Your Decisions From Creating Bigger Problems (Thinking 101 - Ep 6)

Killer Innovations with Phil McKinney

In August 2025, Polish researchers tested something nobody had thought to check: what happens to doctors' skills after they rely on AI assistance? The AI worked perfectly—catching problems during colonoscopies, flagging abnormalities faster than human eyes could. But when researchers pulled the AI away, the doctors' detection rates had dropped. They'd become less skilled at spotting problems on their own. We're all making decisions like this right now. A solution fixes the immediate problem—but creates a second-order consequence that's harder to see and often more damaging than what we...

info_outline
Make Better Decisions When Nothing is Certain show art Make Better Decisions When Nothing is Certain

Killer Innovations with Phil McKinney

You're frozen. The deadline's approaching. You don't have all the data. Everyone wants certainty. You can't give it. Sound familiar? Maybe it's a hiring decision with three qualified candidates and red flags on each one. Or a product launch where the market research is mixed. Or a career pivot where you can't predict which path leads where. You want more information. More time. More certainty. But you're not going to get it. Meanwhile, a small group of professionals—poker players, venture capitalists, military strategists—consistently make better decisions than the rest of us in exactly...

info_outline
You Think In Analogies and You Are Doing It Wrong show art You Think In Analogies and You Are Doing It Wrong

Killer Innovations with Phil McKinney

Try to go through a day without using an analogy. I guarantee you'll fail within an hour. Your morning coffee tastes like yesterday's batch. Traffic is moving like molasses. Your boss sounds like a broken record. Every comparison you make—every single one—is your brain's way of understanding the world. You can't turn it off. When someone told you ChatGPT is "like having a smart assistant," your brain immediately knew what to expect—and what to worry about. When Netflix called itself "the HBO of streaming," investors understood the strategy instantly. These comparisons aren't just...

info_outline
How To Master Causal Thinking show art How To Master Causal Thinking

Killer Innovations with Phil McKinney

$37 billion. That's how much gets wasted annually on marketing budgets because of poor attribution and misunderstanding of what actually drives results. Companies' credit campaigns that didn't work. They kill initiatives that were actually succeeding. They double down on coincidences while ignoring what's actually driving outcomes.   Three executives lost their jobs this month for making the same mistake. They presented data showing success after their initiatives were launched. Boards approved promotions. Then someone asked the one question nobody thought to ask: "Could something else...

info_outline
How to Improve Logical Reasoning Skills show art How to Improve Logical Reasoning Skills

Killer Innovations with Phil McKinney

You see a headline: "Study Shows Coffee Drinkers Live Longer." You share it in 3 seconds flat. But here's what just happened—you confused correlation with causation, inductive observation with deductive proof, and you just became a vector for misinformation. Right now, millions of people are doing the exact same thing, spreading beliefs they think are facts, making decisions based on patterns that don't exist, all while feeling absolutely certain they're thinking clearly.   We live in a world drowning in information—but starving for truth. Every day, you're presented with hundreds of...

info_outline
Why Thinking Skills Matter More Than Ever show art Why Thinking Skills Matter More Than Ever

Killer Innovations with Phil McKinney

The Crisis We're Not Talking About We're living through the greatest thinking crisis in human history—and most people don't even realize it's happening. Right now, AI generates your answers before you've finished asking the question. Search engines remember everything so you don't have to. Algorithms curate your reality, telling you what to think before you've had the chance to think for yourself. We've built the most sophisticated cognitive tools humanity has ever known, and in doing so, we've systematically dismantled our ability to use our own minds. A recent MIT study found that students...

info_outline
How to Build Innovation Skills Through Daily Journaling show art How to Build Innovation Skills Through Daily Journaling

Killer Innovations with Phil McKinney

Most innovation leaders are performing someone else's version of innovation thinking. I've spent decades in this field. Worked with Fortune 100 companies. And here's what I see happening everywhere. Brilliant leaders following external frameworks. Copying methodologies from people they admire. Shifting their approach based on whatever's trendy. But they never develop their own innovation thinking skills. Today, I'd like to share a simple practice that has transformed my life. And I'll show you exactly how I do it. The Problem Here's what I see in corporate America. Leaders are reacting to...

info_outline
The WSJ Got Quarterly Reporting Wrong show art The WSJ Got Quarterly Reporting Wrong

Killer Innovations with Phil McKinney

Michael Dell and his investors spent twenty-five billion dollars to buy back Dell Technologies. But they weren't really buying a company. They were buying freedom from quarterly earnings pressure. I'm Phil McKinney, former CTO of Hewlett-Packard, and I witnessed how this pressure shaped decisions for years. Today, we are exploring why the misses what actually happens inside corporate boardrooms. The Reality of Quarterly Pressure I want to show you what quarterly reporting actually looks like from the inside. Let me paint you a picture. It's week seven of the quarter, and you're in a...

info_outline
How to Get Smarter by Arguing with People who Disagree with You show art How to Get Smarter by Arguing with People who Disagree with You

Killer Innovations with Phil McKinney

What if I told you that the people who disagree with you are actually your secret weapon for better thinking?  Just last month, my wife and I had a heated argument about studio changes I wanted to make here on the ranch. Her immediate reaction was about cost. Mine was about productivity and creativity. We were talking past each other completely. But when I applied what I'm about to teach you, we discovered we were both right—and found a solution that addressed both concerns without compromising either. What started as an argument became a session where each of us was heard and...

info_outline
How to See Opportunities Others Miss show art How to See Opportunities Others Miss

Killer Innovations with Phil McKinney

In 2005, I had a ten-minute conversation at San Jose Airport that generated billions in revenue for HP. But here's what's fascinating: three other HP executives heard the exact same conversation and saw nothing special about it. If you read Monday's Studio Notes, you know this story from the emotional side—what it felt like to have that breakthrough moment, the internal resistance I faced, the personal transformation that followed. Today I'm delivering on my promise to give you the complete tactical methodology behind that insight. I'm going to show you the systematic framework I call...

info_outline
 
More Episodes

You're frozen. The deadline's approaching. You don't have all the data. Everyone wants certainty. You can't give it. Sound familiar?

Maybe it's a hiring decision with three qualified candidates and red flags on each one. Or a product launch where the market research is mixed. Or a career pivot where you can't predict which path leads where. You want more information. More time. More certainty. But you're not going to get it.

Meanwhile, a small group of professionals—poker players, venture capitalists, military strategists—consistently make better decisions than the rest of us in exactly these situations. Not because they have more information, but because they've mastered something fundamentally different: they think in probabilities, not certainties. I learned this the hard way—I once created a biometric security algorithm that the NSA reverse-engineered, where I mastered probabilistic thinking perfectly in the technology, then made every wrong bet with the business around it.

By the end of this episode, you'll possess a powerful mental toolkit that transforms how you approach uncertainty. You'll learn to estimate likelihoods without perfect data, update your beliefs as new information emerges, make confident decisions when multiple uncertain factors collide, and act decisively even when you can't guarantee the outcome. This is the difference between paralysis and power, between gambling recklessly and betting wisely.

What Is Probabilistic Thinking?

But what does probabilistic thinking actually entail? At its core, it's the practice of reasoning in terms of likelihoods rather than absolutes—thinking in percentages instead of yes-or-no answers. Instead of asking "Will this work?" you ask "What are the odds this will work, and what are the consequences if it doesn't?" This approach acknowledges that the future is uncertain and that every decision carries risk. By quantifying that uncertainty and weighing it against potential outcomes, you make smarter choices even when you can't eliminate the unknown.

The Cost of Demanding Certainty

Today's world punishes those who demand certainty before acting. Research from Oracle's 2023 Decision Dilemma study—which surveyed over 14,000 employees and business leaders across 17 countries—found that 86% feel overwhelmed by the amount of data available to them. Rather than clarity, all that information creates decision paralysis.

And the paralysis has real consequences. When we can't be certain, we freeze. We endlessly research options, seeking that final piece of data that will guarantee success. We postpone critical decisions, waiting for perfect information that never arrives. Meanwhile, opportunities pass us by, problems grow worse, and competitors who are comfortable with uncertainty move forward.

This demand for certainty doesn't just slow us down—it exhausts us. Decision fatigue sets in as we agonize over choices, draining our mental resources until we either make impulsive decisions or avoid deciding altogether. Neither outcome serves us well.

What Certainty-Seeking Actually Costs You

Here's what it looks like in real life: You're the VP of Marketing. Your CMO wants a decision on next quarter's campaign budget by Friday. You have three agencies to choose from, each with strengths and weaknesses. So you ask for more data. Customer focus groups. Competitive analysis. Agency references. By Wednesday you're drowning in spreadsheets and conflicting opinions.

Friday arrives. You still can't be certain which choice is right, so you ask for an extension. Two weeks later, you finally pick one—not because you're confident, but because you're exhausted and the CMO is furious about the delay. The campaign launches late. You've burned political capital. And you still have no idea if you made the right choice.

Meanwhile, your competitor's marketing VP looked at the same decision, spent two hours assessing the probabilities, and launched on time. If it works, great. If it doesn't, they'll pivot. They didn't need certainty. They needed enough information to make a good bet.

That's the tax you pay for demanding certainty: missed timing, exhausted teams, and decisions made from fatigue rather than judgment.

Meanwhile, a small group of professionals thrives in these exact conditions. Professional poker players like Annie Duke understand that good decisions sometimes lead to bad outcomes and bad decisions sometimes get lucky—so they judge their choices by process, not results. Venture capitalists often see that most of their investments will fail, but they bet anyway because one success out of twenty can return the entire fund. Military strategists make life-and-death decisions with incomplete intelligence, not because they're reckless, but because waiting for perfect information means defeat.

The difference isn't access to better information. It's the willingness to act on probabilities rather than certainties.

How To Make Better Decisions When Nothing Is Certain

So how do you actually develop this skill? It's more accessible than you might think. Here are clear strategies to transform how you process uncertainty and make decisions.

Think in Ranges, Not Points

The first shift in probabilistic thinking is abandoning single-number estimates for ranges of possibility. When most people predict an outcome, they pick one number: "Sales will be $500,000 next quarter" or "This project will take three months." But the world doesn't work that way. Every estimate carries uncertainty, and pretending otherwise sets you up for failure.

Professional forecasters think differently. They don't ask "What will happen?" They ask "What's the range of plausible outcomes, and how likely is each?" This approach forces you to acknowledge what you don't know while still making useful predictions.

Watch a professional poker player deciding whether to call a bet. They're not thinking "Do I have the best hand?" They're thinking "Given what I've seen, maybe 35% chance I have the best hand, 20% chance my opponent is bluffing, 45% chance they've got me beat." They act on probabilities, not certainties.

Steps to implement range thinking:

  1. Replace point estimates with probability ranges. When making any prediction, state a range instead of a single number. Instead of "We'll close 50 deals," say "We'll likely close 40-60 deals, with a small chance of 30-70."

     

  2. Assign rough percentages to your ranges. You don't need mathematical precision—just honest self-assessment. Estimate: "60% chance of 40-50 deals, 30% chance of 50-60, 10% chance outside that range." This forces you to think about likelihood, not just possibility.

     

  3. Track your estimates against actual outcomes. Keep a simple log of your predictions and what actually happened. Over time, you'll discover if you're consistently over-optimistic, over-cautious, or actually well-calibrated. This feedback loop is how you improve.

     

Update Your Beliefs with New Evidence

One of the most powerful aspects of probabilistic thinking is treating your beliefs as hypotheses, not conclusions. When new information emerges, skilled thinkers update their probability estimates rather than clinging to their original position. This practice—called Bayesian updating after the mathematician Thomas Bayes—is how professionals stay accurate in changing environments.

Consider a doctor diagnosing a patient with intermittent chest pain. Initially, based on the patient's age and health history, she estimates a 15% probability of heart disease. Then the EKG comes back with minor abnormalities—not definitive, but concerning. She updates her estimate to 35%. Blood work shows elevated cardiac markers. Now she's at 65%. Each piece of evidence shifts the probability, but none gives absolute certainty. She doesn't wait for 100% certainty to act—she orders more tests and starts precautionary treatment based on her updated 65% estimate. That's Bayesian thinking in action.

Financial firms continuously adjust their models as new data arrives. Weather forecasters update storm predictions hourly. In my own work building biometric security systems, we updated our false acceptance and rejection rates constantly—but I failed to apply that same updating framework to the business model itself.

The enemy of updating is confirmation bias—our tendency to accept information that supports our existing beliefs and dismiss information that contradicts them. When you're emotionally invested in being right, you'll unconsciously filter evidence to protect your original view.

Steps to update your thinking:

  1. Start with a baseline probability before you have strong evidence. If you're launching a new product, estimate: "Based on what I know about similar products, there's maybe a 40% chance this succeeds." That's your prior—your starting point before specific evidence comes in.

     

  2. When new information arrives, ask: "How much should this change my estimate?" Not all evidence is equal. Strong evidence—like actual customer purchases—should move your probability significantly. Weak evidence—like one person's opinion—should barely budge it.

     

  3. Separate the quality of a decision from the quality of the outcome. This is crucial. A good decision based on sound probabilities can still result in a bad outcome due to chance. Conversely, a terrible decision can get lucky. Judge yourself on whether you correctly assessed the probabilities and acted accordingly, not on whether you "got it right" this time.

     

  4. Actively seek disconfirming evidence. Force yourself to look for information that contradicts your current view. If you think your strategy will work, deliberately search for reasons it might fail. This counteracts confirmation bias and gives you a more accurate probability estimate.

     

Make Decisions by Expected Value

Probabilistic thinking isn't just about estimating odds—it's about acting on them. The concept of expected value gives you a framework for making decisions when outcomes are uncertain. Expected value multiplies each possible outcome by its probability, then adds them together. It's how professionals decide whether a bet is worth taking.

Here's why it matters: sometimes a decision with a low probability of success is still the right choice if the potential payoff is enormous. Venture capitalists know that perhaps 18 out of 20 startups in their portfolio will fail or return little money. But that one company that becomes the next Airbnb or Uber can return 100x their investment—more than covering all the losses. That's positive expected value thinking.

Conversely, decisions that seem "safe" can be terrible bets. Playing it safe might give you a 90% chance of mediocre success, but if that 10% downside risk includes catastrophic consequences, the expected value might be negative. This is why you buy insurance: the probability of your house burning down is low, but the cost if it happens is devastating.

Think about a parent choosing between schools for their child. Public school is free but overcrowded. Private school costs $20K/year with smaller classes but adds an hour of family stress daily. Charter school is free with innovative curriculum but it's a first-year program with unknowns. There's no guarantee. The better question is expected value: "Given the probabilities and what matters most to us—academic success, family time, financial stability—which bet has the best expected outcome?"

Steps for expected value decision-making:

  1. List all plausible outcomes for your decision, not just the best and worst. For a job offer, don't just think "great career move" versus "terrible mistake." Consider: "Modest improvement (40%), breakthrough opportunity (20%), lateral move (25%), step backward (10%), complete disaster (5%)."

     

  2. Assign a rough value to each outcome. This doesn't have to be money—it can be career satisfaction, life quality, time saved, or any currency that matters to you. The key is making the values comparable across outcomes.

     

  3. Multiply each outcome's value by its probability, then add them up. This gives you the expected value. If the positive expected value option has meaningful downside risk, ask: "Can I survive the worst case?" If yes, it's usually the right bet.

     

  4. Remember: expected value is about long-term results, not single instances. If you make a high expected value bet and it fails, that doesn't mean you were wrong. Over many decisions, following expected value will outperform any other approach. Trust the math, not the emotional reaction to one outcome.

     

Practice: The Probability Forecast Journal

A practical way to develop your probabilistic thinking is to keep a Probability Forecast Journal. This exercise builds calibration—your ability to accurately assess how confident you should be in your predictions.

Here's how to implement it:

  1. Choose three areas where you regularly make predictions. These could be work-related (project timelines, sales numbers), personal (will your flight be delayed), or current events (election outcomes).

     

  2. Each week, make five specific, testable predictions. Write down the prediction and assign a probability. For example: "70% chance the client approves our proposal by Friday" or "85% chance our website traffic increases this month."

     

  3. After each prediction resolves, record the actual outcome. Did the thing you said had a 70% chance of happening actually happen? Don't judge yourself harshly on any single prediction—remember that a 70% prediction should fail about 30% of the time.

     

  4. Monthly, analyze your calibration. Look at all predictions where you said "70% confident"—did roughly 70% of them come true? If you're consistently overconfident, you need to adjust. If you're underconfident, you're being too cautious.

     

The goal isn't perfection—it's calibration. After several months of this practice, you'll notice your ability to assess probabilities improves dramatically. You'll know when you're 60% sure versus 90% sure, and you'll make better decisions as a result.

The Rewards

Mastering probabilistic thinking is a journey, not a destination. It requires practice, humility about what you don't know, and the courage to act despite uncertainty. But the rewards are substantial.

When you think probabilistically, you make faster decisions because you're not paralyzed waiting for certainty that will never come. You become more resilient to failure because you understand that good decisions sometimes have bad outcomes—and that's not a reason to change your approach.

You'll find yourself taking calculated risks that others avoid, capturing opportunities that demand action before perfect information arrives. You'll waste less time second-guessing yourself because you've already thought through the probabilities and made your peace with uncertainty. You'll explain your decisions more clearly to others because you can articulate not just what you think will happen, but how confident you are and why.

Most importantly, you'll stop confusing confidence with correctness. In a world obsessed with appearing certain, probabilistic thinkers have the courage to say "I'm 65% sure, and that's enough to act." That honesty—with yourself and others—is the foundation of better judgment.

Want to see what happens when you master probabilistic thinking in one domain but fail to apply it in another? I wrote about my experience creating a fingerprint recognition algorithm that the NSA reverse-engineered—where I got the technical probabilities right and the business bets completely wrong. [Read the full story here](link to substack).

The future will always be uncertain. The question is whether you'll be paralyzed by that uncertainty or empowered by it.

 

If this helped you think differently about decision-making, I'd really appreciate it if you'd hit the like button and subscribe—it genuinely helps others find this content through the algorithm. And click that notification bell so you don't miss the next episode in this series.

If you want to go deeper, I share the behind-the-scenes thinking, mistakes, and extended stories over on Studio Notes on Substack. Paid subscriptions help cover the costs of the team who makes all of this possible—the editing, research, and production work that gets these episodes to you each week. None of it comes to me; it all goes to supporting them. Without this team, there'd be no podcast, no YouTube channel, no articles. So if you find value in this work, that's a meaningful way to keep it going.

The future will always be uncertain. The question is whether you'll be paralyzed by it or empowered by it.

 

Sources Cited In This Episode

Oracle Decision Dilemma Study (2023) - Survey of 14,000+ employees and business leaders across 17 countries on data overwhelm and decision paralysis. https://www.oracle.com/uk/cloud/decision-dilemma/

Thinking in Bets - Duke, A. (2018). Portfolio. On judging decisions by process, not outcomes. https://www.penguinrandomhouse.com/books/552885/thinking-in-bets-by-annie-duke/

How to Improve Bayesian Reasoning Without Instruction: Frequency Formats - Gigerenzer, G. & Hoffrage, U. (1995). Psychological Review, 102(4), 684-704. On updating beliefs with evidence.

Prospect Theory: An Analysis of Decision under Risk - Kahneman, D. & Tversky, A. (1979). Econometrica, 47(2), 263-291. Prospect Theory foundations.