Making AI Work in the Real World with Will Grannis (Google Cloud)
Release Date: 12/11/2024
Days to Seconds: Harnessing Confidential AI Agents with Kellie Romack
AI Confidential
In the age of agentic AI, knows deploying secure agents needs to be a baseline for enterprises, not an aspiration. In this episode, host unpacks how confidential AI agents work and talks to , CDIO at ServiceNow, about how her company is implementing confidential AI agents across its platform. Since partnering with , Microsoft Azure, and NVIDIA to deploy confidential AI agents, ServiceNow has seen average response times from its sales commission help desk speed up from four days to just eight seconds. Kellie and Aaron also discuss: How ServiceNow, a defining enterprise software company,...
info_outline
Agents Are the New API Client with Marco Palladino
AI Confidential
knows that the internet is changing quickly. As the Co-founder and CTO at Kong, an API management platform, he’s on the forefront of integrating APIs with AI — and is wrestling with the questions around security and governance that this shift presents. In this episode, hosts and talk to Palladino about: LLM gateways and why we need them How AI is impacting API development Why AI governance is — and will continue to be — a challenge How enterprises can prepare for the agentic web If you want to learn more about AI and how to benefit from it responsibly, visit
info_outline
Confidential Computing Summit 2025: Day 2 Recap & Interviews
AI Confidential
Last month at Opaque’s annual , hosts Aaron Fulkerson and Mark Hinkle interviewed several of our incredible speakers and sponsors about the agentic web, data security, and AI. This episode dives into a few of those conversations. First, — CISO at Anthropic — talks about the future of agents, MCP, and Anthropic’s latest safety upgrade, ASL-3, which is designed to prevent bad actors from misusing its models. Next, — NVIVIA's VP of Software Product Security, Architecture & Research —shares how NVIDIA is handling AI security and scaling compute power and trust. Finally, —...
info_outline
Confidential Computing Summit 2025: Day 1 Recap & Interviews
AI Confidential
Last month at Opaque’s annual , hosts Aaron Fulkerson and Mark Hinkle interviewed several of our incredible speakers about the future of confidential AI, genAI, and agents. This episode dives into a few of those conversations. First, — CTO, Deputy CISO, and Technical Fellow at Microsoft Azure — talks to us about recent developments in confidential AI from his research team, including a new framework for thinking about the various security levels available for data using confidential computing. Next, — CTO at McKinsey Technology and Partner at McKinsey — shares takeaways from...
info_outline
Understanding the Internet of Agents with Vijoy Pandey
AI Confidential
Vijoy Pandey, Head of , understands that an internet populated by agents requires an open, interoperable framework for agent-to-agent communication and a seismic shift in governance. That’s why Outshift by Cisco, in partnership with LangChain and Galileo, created — an open source collective for inter-agent collaboration. And we’re excited to announce that Opaque is a member! In this episode, Pandey talks to hosts Aaron Fulkerson and Mark Hinkle about: His aims for AGNTCY How we create an open-source, collaborative, interoperable, and secure internet of agents If you want to...
info_outline
Understanding Data Complexity in Enterprise AI Systems with John Willis
AI Confidential
What would Founder, Systems Architect, and Deeptech Strategist, John Willis, like you to understand? The history of AI and the risks associated with data exhaust. Willis recently published , an AI history told through the stories of lesser-known technologists who built the foundation for modern-day AI. And one of the biggest threats he’s flagging for enterprise AI users is data exhaust, byproduct info that's generated while using digital systems. From manufacturing process details to AI model configurations, this data trail is growing fast and can be collected and exploited. Also...
info_outline
Navigating AI Evaluation and Observability with Atin Sanyal
AI Confidential
As GenAI tools have become more intelligent and robust, the reliability of their output has decreased. Enter : an AI reliability platform designed for GenAI applications. — the Co-founder and CTO of Galileo — has a background building machine learning tech at Uber and Apple. One innovative technique that sets Galileo apart is ChainPoll — their hallucination detection methodology that uses consensus scoring and prompts the LLM to outline its step-by-step reasoning process. In this episode, hosts Aaron Fulkerson and Mark Hinkle talk to Atin about: What evaluation agents...
info_outline
On the Cutting Edge of Agentic AI with João Moura
AI Confidential
built the agentic AI open source framework, , with a central vision: to make agent creation feel borderline magical. Inspired by the Ruby on Rails philosophy of “convention over configuration,” CrewAI is designed for speed, clarity, and ease of use. What we love about João’s approach to agentic AI is that he’s not just disrupting the market. He’s shifting the way enterprise leaders think about long-term workflows and processes, too. In this episode, hosts Aaron Fulkerson and Mark Hinkle talk to João about: Why interoperability across your stack is essential for scaling AI The...
info_outline
How AI is reshaping enterprise technology with James Kaplan
AI Confidential
James Kaplan has been consulting enterprise clients on how to adopt and extract value from cutting-edge technologies for over 25 years. His dual role as Partner at McKinsey and CTO at McKinsey Technology gives him a unique vantage point into how CIOs and CTOs can harness AI to drive automation, increase productivity, and enhance data security. In this episode, host Aaron Fulkerson talks to James about: How AI is changing the enterprise technology landscape What enterprises should be thinking about as they’re adopting and building AI systems How to avoid the “IT doom loop" If you want to...
info_outline
Building transparent, open-source AI with Sriram Raghavan
AI Confidential
Hosts Aaron Fulkerson and Mark Hinkle sit down with , Vice President of IBM Research AI, at the conference. As an experienced industry expert, Sriram leads a global team of over 750 research scientists and engineers focused on advancing AI. Sriram and IBM believe that the future of AI is open source. That’s why IBM recently contributed three AI projects — Docling, Data Prep Kit, and BeeAI — to the Linux Foundation. And while there is a lot of hype around LLMs right now, IBM is leaning into smaller “fit-for-purpose” models that give developers choice. In the episode,...
info_outlineAI is full of potential, but what does it really take to make it work in complex environments? Will Grannis, CTO and VP at Google Cloud, shares his perspective on bridging AI innovation with practical application, including insights into the real challenges and rewards of implementing AI in today’s top enterprises.