The Apparent Meaninglessness of AI Benchmarks, plus How to Explain AI Opportunities to Others
Raw Data with Rob Collie
Every week brings a new AI benchmark. Higher scores. Bigger claims. Louder voices insisting this changes everything. And yet, when you put AI in front of a real business problem, none of that noise seems to help. In this episode, Rob and Justin dig into why AI benchmarks often feel strangely meaningless in practice and why that disconnect is the point. Benchmarks aren’t useless. They’re just answering a different question than the one most businesses are asking. This isn’t just random conjecture either. Rob walks through what he’s learned building actual AI workflows and why a twenty...
info_outline
The Power BI Fundamentals Behind Expert Development *and* AI Simplicity, w/ Microsoft's Rui Romano
Raw Data with Rob Collie
Everyone keeps asking whether AI kills Power BI or makes it stronger. Rui Romano flips that entire question on its head. As the Microsoft PM behind PBIP, TMDL, and all the file format work that rebuilt Power BI's foundation, he explains how the platform accidentally became one of the most AI-ready systems in analytics - and it wasn't by accident, not really. His team was solving problems for real developers who were tired of unsupported workarounds and offshore relay races. They weren't training agents. But the work they did means AI now feels native instead of duct-taped on. What we learned...
info_outline
Why We Should Stop Paying Attention to the % of AI Projects which Fail (and Instead Learn Why the Others Succeed)
Raw Data with Rob Collie
This episode starts with a familiar scene. A role opens, the applications pour in, and suddenly you’re staring at a mountain of resumes that deserve real attention but arrive faster than anyone can process. The mix had everything… experienced candidates, newcomers trying to break in, and a growing stack of AI-generated submissions that looked sharp until you asked a second question. That’s where Haystack came in. Instead of using AI as a blunt filter, Rob and the team treated it like a collaborator. Teach it what matters. Teach it what P3 looks for in a teammate. Teach it how to separate...
info_outline
Cat Negotiations, Dishonest Chatbots, AI vs AI in the Job Market, and More Real World AI Use Cases
Raw Data with Rob Collie
Rob finally cracked his years long standoff with the podcast lair cat, and the fix was hilariously simple. That small victory ends up setting the tone for the whole episode, because everything that follows has the same energy: real problems that only make sense once you shrink the solution down. As Rob talks through the cat truce, Justin brings in a different kind of chaos. A customer service bot that sounded fully in command yet never actually did the thing it said it did. Pair that with a hiring queue full of AI written applications, and the whole picture starts to come into focus. Once you...
info_outline
Customizing AI for Your Business is Crucial But It Isn't Hard
Raw Data with Rob Collie
Everyone’s talking about AI like it’s plug-and-play. Spoiler: it’s not. In this episode, Rob digs into why Big Tech’s billions in AI R&D haven’t yet turned into matching revenue — and what that means for the rest of us. The truth? The real business wins don’t come from off-the-shelf models; they come from smart customization. Rob breaks down the “magic Lego brick” approach that separates hype from practical reality, showing how everyday tools like Power BI and Power Automate can connect to AI in surprisingly simple (and powerful) ways. He also revisits Bill Krolicki’s...
info_outline
Is AI a Bubble?
Raw Data with Rob Collie
When the bubble pops, what’s left standing? Everyone’s calling AI a bubble — and yeah, there’s some wild stuff happening behind the scenes. Billions changing hands between the same few tech giants. Investments that look more like circular loans than innovation. But what if the real bubble isn’t AI at all? Rob breaks down what’s really inflating, what’s not, and why your business shouldn’t lose sleep over it. The headlines may sound like the sky’s falling, but the tools driving real results aren’t going anywhere. Some bubbles burst. Others just float higher. Listen now to...
info_outline
Getting Specific with AI via Categories: Chat, Headless, and Embedded
Raw Data with Rob Collie
Everyone’s talking about AI. Almost no one’s getting specific. And that’s the problem. Rob and Justin break down the three categories that matter: chat agents you talk to, embedded assistants baked into your workflows, and headless systems running quietly in the background doing the grunt work nobody wants to do. This isn’t theory. This is how AI is finally working for real companies. They walk through Vendor Bot, Scheduler Bot, and Budget Bot — small, focused tools that do one thing exceptionally well. Because here’s what keeps happening: the “one bot to rule them all”...
info_outline
AI Agents for the Manufacturing Industry, w/ Interpak CFO Bill Krolicki
Raw Data with Rob Collie
AI without the committee: Most manufacturers are still holding meetings about AI. Bill Krolicki just built it. As CFO of Interpak, he didn't wait for a strategy deck or a vendor pilot—he wired Power BI and Power Automate into a self-running operation. His bots read supplier emails, catch late shipments before they blow up production, and update the ERP while everyone else is still asking who owns the spreadsheet. Rob Collie and Justin Mannhardt sit down with Bill to talk about what happens when finance stops waiting and starts building. From "Vendor Bot" to the soon-to-launch "Budget Bot,"...
info_outline
AI is "Just" a New Faucet, plus the Value of Getting Specific
Raw Data with Rob Collie
Last week we got a facelift—new name, new look, same deep data dives. This week? We prove the rebrand wasn't just cosmetic. Rob kicks things off with a time machine moment: his first gig at Microsoft in the '90s, building the Windows Installer. The running joke back then? "Installing yesterday's apps tomorrow." Cut to 2025, and that exact same code shows up while he's configuring an AI tool for data modeling. Build something right, and it really sticks around. And that’s the bridge, AI context management isn't some brave new world. It's the same discipline that made Power BI models and...
info_outline
YOU are the AI Cavalry
Raw Data with Rob Collie
Everyone’s talking like AI is coming for your job. Rob’s here to tell you it’s coming for your skill set. If you already think in tables, models, and relationships, congratulations—you’re built for what’s next. This episode is part pep talk, part reality check, and all proof that data people aren’t getting replaced. We’re getting promoted. Rob takes you inside Microsoft’s campus and out into the real world, where big firms are burning millions on AI theater while mid-market teams quietly pull ahead. The twist? You don’t need to change the AI to win with it. You just need to...
info_outlineSakiko Stickley joins Raw Data to share a story that is part inspiration, part revelation, and a whole lot of truth-telling. From the first moment she discovered Power Pivot, Sakiko did not just learn data. She lived it. She rewired reporting systems, survived micromanagers, and navigated the strange realities of big consulting firms, all while quietly proving that one person, one model, and a little bit of DAX can change everything.
In this episode, we get an inside look at how a passion for smarter systems can collide with corporate inertia, what it really feels like to challenge the status quo, and why Sakiko believes AI could someday outperform human leadership, not just in data crunching but in ethics and decision-making too. (Spoiler: She might be right.)
If you have ever felt like a lone voice in a world that clings to inefficient processes, Sakiko’s journey will feel like a kindred spirit calling from across the data universe. Listen in for a conversation filled with hard truths, breakthrough moments, and a reminder that true data people do not just build models. They build better futures.