AI Confidential

AI Confidential is a podcast about AI and how to benefit from it responsibly. We speak with leaders from Microsoft, Accenture, NVIDIA, Google Cloud — and more — about how confidential AI is reshaping business.

Days to Seconds: Harnessing Confidential AI Agents with Kellie Romack 09/09/2025

Days to Seconds: Harnessing Confidential AI Agents with Kellie Romack In the age of agentic AI, knows deploying secure agents needs to be a baseline for enterprises, not an aspiration. In this episode, host unpacks how confidential AI agents work and talks to , CDIO at ServiceNow, about how her company is implementing confidential AI agents across its platform. Since partnering with , Microsoft Azure, and NVIDIA to deploy confidential AI agents, ServiceNow has seen average response times from its sales commission help desk speed up from four days to just eight seconds. Kellie and Aaron also discuss: How ServiceNow, a defining enterprise software company, is approaching AI governance Advice for enterprise leaders building out agentic workflows Predictions on how companies can gain the most value from AI If you want to learn more about AI and how to benefit from it responsibly, visit Special thanks to Now Productions for filming this interview at ServiceNow's headquarters in Santa Clara. /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/38139405

Agents Are the New API Client with Marco Palladino 08/12/2025

Agents Are the New API Client with Marco Palladino knows that the internet is changing quickly. As the Co-founder and CTO at Kong, an API management platform, he’s on the forefront of integrating APIs with AI — and is wrestling with the questions around security and governance that this shift presents. In this episode, hosts and talk to Palladino about: LLM gateways and why we need them How AI is impacting API development Why AI governance is — and will continue to be — a challenge How enterprises can prepare for the agentic web If you want to learn more about AI and how to benefit from it responsibly, visit /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/37770625

Confidential Computing Summit 2025: Day 2 Recap & Interviews 07/29/2025

Confidential Computing Summit 2025: Day 2 Recap & Interviews Last month at Opaque’s annual , hosts Aaron Fulkerson and Mark Hinkle interviewed several of our incredible speakers and sponsors about the agentic web, data security, and AI. This episode dives into a few of those conversations. First, — CISO at Anthropic — talks about the future of agents, MCP, and Anthropic’s latest safety upgrade, ASL-3, which is designed to prevent bad actors from misusing its models. Next, — NVIVIA's VP of Software Product Security, Architecture & Research —shares how NVIDIA is handling AI security and scaling compute power and trust. Finally, — Co-Founder and CEO of Flower Labs — explains how his company is using federated learning to keep data secure in AI workloads. If you want to learn more about AI and how to benefit from it responsibly, visit /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/37587555

Confidential Computing Summit 2025: Day 1 Recap & Interviews 07/15/2025

Confidential Computing Summit 2025: Day 1 Recap & Interviews Last month at Opaque’s annual , hosts Aaron Fulkerson and Mark Hinkle interviewed several of our incredible speakers about the future of confidential AI, genAI, and agents. This episode dives into a few of those conversations. First, — CTO, Deputy CISO, and Technical Fellow at Microsoft Azure — talks to us about recent developments in confidential AI from his research team, including a new framework for thinking about the various security levels available for data using confidential computing. Next, — CTO at McKinsey Technology and Partner at McKinsey — shares takeaways from his research into how large enterprises are using AI and explains how genAI is allowing enterprises to mine troves of unstructured data. Finally, — Chief Architect and VP of Engineering, Digital Technology, and Technology Platform at ServiceNow — explains how ServiceNow is using confidential agents powered by Opaque, Microsoft Azure, and NVIDIA to improve their sales commission desk response times from four days to eight seconds. If you want to learn more about AI and how to benefit from it responsibly, visit /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/37409900

Understanding the Internet of Agents with Vijoy Pandey 07/01/2025

Understanding the Internet of Agents with Vijoy Pandey Vijoy Pandey, Head of , understands that an internet populated by agents requires an open, interoperable framework for agent-to-agent communication and a seismic shift in governance. That’s why Outshift by Cisco, in partnership with LangChain and Galileo, created — an open source collective for inter-agent collaboration. And we’re excited to announce that Opaque is a member! In this episode, Pandey talks to hosts Aaron Fulkerson and Mark Hinkle about: His aims for AGNTCY How we create an open-source, collaborative, interoperable, and secure internet of agents If you want to learn more about AI and how to benefit from it responsibly, visit /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/37233410

Understanding Data Complexity in Enterprise AI Systems with John Willis 06/17/2025

Understanding Data Complexity in Enterprise AI Systems with John Willis What would Founder, Systems Architect, and Deeptech Strategist, John Willis, like you to understand? The history of AI and the risks associated with data exhaust. Willis recently published , an AI history told through the stories of lesser-known technologists who built the foundation for modern-day AI. And one of the biggest threats he’s flagging for enterprise AI users is data exhaust, byproduct info that's generated while using digital systems. From manufacturing process details to AI model configurations, this data trail is growing fast and can be collected and exploited. Also in this episode, you’ll hear about: Why legacy systems and tech debt still haunt AI adoption How the NORMAL stack embeds AI governance into every layer of the enterprise Why RAG isn’t dead If you want to learn more about AI and how to benefit from it responsibly, visit /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/37037860

Navigating AI Evaluation and Observability with Atin Sanyal 06/03/2025

Navigating AI Evaluation and Observability with Atin Sanyal As GenAI tools have become more intelligent and robust, the reliability of their output has decreased. Enter : an AI reliability platform designed for GenAI applications. — the Co-founder and CTO of Galileo — has a background building machine learning tech at Uber and Apple. One innovative technique that sets Galileo apart is ChainPoll — their hallucination detection methodology that uses consensus scoring and prompts the LLM to outline its step-by-step reasoning process. In this episode, hosts Aaron Fulkerson and Mark Hinkle talk to Atin about: What evaluation agents are, and why they get smarter over time How Galileo helps enterprises evolve their own AI quality metrics Why data quality and confidential computing will become increasingly important to enterprises building AI systems If you want to learn more about AI and how to benefit from it responsibly, visit /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/36826915

On the Cutting Edge of Agentic AI with João Moura 05/20/2025

On the Cutting Edge of Agentic AI with João Moura built the agentic AI open source framework, , with a central vision: to make agent creation feel borderline magical. Inspired by the Ruby on Rails philosophy of “convention over configuration,” CrewAI is designed for speed, clarity, and ease of use. What we love about João’s approach to agentic AI is that he’s not just disrupting the market. He’s shifting the way enterprise leaders think about long-term workflows and processes, too. In this episode, hosts Aaron Fulkerson and Mark Hinkle talk to João about: Why interoperability across your stack is essential for scaling AI The importance of building secure AI systems How managers are uniquely equipped to build effective agents The dangers of “agent washing" and how to see through the hype If you want to learn more about AI and how to benefit from it responsibly, visit /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/36637075

How AI is reshaping enterprise technology with James Kaplan 05/06/2025

How AI is reshaping enterprise technology with James Kaplan James Kaplan has been consulting enterprise clients on how to adopt and extract value from cutting-edge technologies for over 25 years. His dual role as Partner at McKinsey and CTO at McKinsey Technology gives him a unique vantage point into how CIOs and CTOs can harness AI to drive automation, increase productivity, and enhance data security. In this episode, host Aaron Fulkerson talks to James about: How AI is changing the enterprise technology landscape What enterprises should be thinking about as they’re adopting and building AI systems How to avoid the “IT doom loop" If you want to learn more about AI and how to benefit from it responsibly, visit /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/36447355

Building transparent, open-source AI with Sriram Raghavan 04/22/2025

Building transparent, open-source AI with Sriram Raghavan Hosts Aaron Fulkerson and Mark Hinkle sit down with , Vice President of IBM Research AI, at the conference. As an experienced industry expert, Sriram leads a global team of over 750 research scientists and engineers focused on advancing AI. Sriram and IBM believe that the future of AI is open source. That’s why IBM recently contributed three AI projects — Docling, Data Prep Kit, and BeeAI — to the Linux Foundation. And while there is a lot of hype around LLMs right now, IBM is leaning into smaller “fit-for-purpose” models that give developers choice. In the episode, Sriram also digs into: IBM’s approach to open-source models What innovations he sees coming for enterprise AI How his team is approaching responsible, secure AI /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/36248890

Unleashing the Power of Agents with the "Forrest Gump of Tech" 04/09/2025

Unleashing the Power of Agents with the "Forrest Gump of Tech" From cloud computing to infrastructure-as-a-service, Reuven Cohen (AKA ) has been on the cutting edge of every major technology supercycle — and he’s now one of the most influential people in the agentic AI space. With the help of agents, rUv produced 10 million lines of usable code last year. That’s 33,000 years of output from one human. rUv’s approach proves one of two things: he’s either an outlier or a leading indicator of what’s to come. In this episode, we talk to rUv about: His approach to training autonomous agents The rapid advancements in agentic code development Why LLMs are vulnerable to data poisoning Why Python is bad for agentic development /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/36054740

Protecting Our Future from AI With Jason Clinton (Anthropic) 12/18/2024

Protecting Our Future from AI With Jason Clinton (Anthropic) What does it take to ensure AI is safe, ethical, and resilient? In this season finale, Anthropic’s CISO joins Aaron to discuss the critical intersection of innovation, data privacy, and sovereignty, offering an optimistic perspective on what lies ahead for the future of confidential AI. /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/34497955

Making AI Work in the Real World with Will Grannis (Google Cloud) 12/11/2024

Making AI Work in the Real World with Will Grannis (Google Cloud) AI is full of potential, but what does it really take to make it work in complex environments? Will Grannis, CTO and VP at Google Cloud, shares his perspective on bridging AI innovation with practical application, including insights into the real challenges and rewards of implementing AI in today’s top enterprises. /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/34400080

Privacy Meets Innovation with Daniel Rohrer (NVIDIA) and Raluca Ada Popa (Opaque) 12/05/2024

Privacy Meets Innovation with Daniel Rohrer (NVIDIA) and Raluca Ada Popa (Opaque) Can AI be both innovative and private? NVIDIA VP of Software Security Daniel Rohrer and Opaque Co-Founder and President Raluca Ada Popa discuss the advancements in privacy-preserving technology that enable organizations to push AI forward without compromising data sovereignty. /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/34285490

Safe and Secure Generative AI with Teresa Tung (Accenture) 11/26/2024

Safe and Secure Generative AI with Teresa Tung (Accenture) Generative AI is transforming industries—but how do we ensure it’s safe? Teresa Tung, Senior Managing Director & Global Data Capability Lead at Accenture, dives into what companies need to make generative AI both impactful and secure, exploring the frameworks that bring safety to scale. /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/34162725

Building Trust in AI With Mark Papermaster (AMD) and Mark Russinovich (Microsoft Azure) 11/20/2024

Building Trust in AI With Mark Papermaster (AMD) and Mark Russinovich (Microsoft Azure) How do you build AI applications that are not only powerful but also trustworthy and easy to adopt? Join Mark Papermaster, CTO & EVP at AMD, and Mark Russinovich, CTO & Deputy CISO at Microsoft Azure, as they discuss the essential role of confidential computing in making AI seamless, secure, and accessible to businesses everywhere. /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/34037377

Trailer 11/13/2024

Trailer Welcome to AI Confidential, the podcast that explores the future of AI and data sovereignty. In today’s rapidly evolving tech landscape, AI is at the heart of transformation across industries. From finance to high tech, leaders are racing to harness its power while navigating complex challenges like data sovereignty, regulatory compliance, and privacy. But what if there was a way to solve these problems without sacrificing innovation? On AI Confidential, join host Aaron Fulkerson as he dives deep with visionaries from AMD, Accenture, Google Cloud, Microsoft Azure, NVIDIA, Opaque Systems, and more to uncover how confidential computing is reshaping what’s possible for AI. Together, they explore pressing questions, share groundbreaking use cases, and take bold steps in predicting AI's future. /episode/index/show/c1129cdd-7752-4bb7-bd90-11f302f4e807/id/33918222

AI Confidential

TOPICS