#298 Ryan Kolln: How Appen Trains the World’s Most Powerful AI Models
Release Date: 11/06/2025
#303 Fei-Fei Li: Spatial Intelligence, World Models & the Future of AI
Eye On A.I.
This episode is sponsored by AGNTCY. Unlock agents at scale with an open Internet of Agents. Visit and add your support. How will AI evolve once it can understand and reason about the 3D world, not just text on a screen? In this episode of Eye on AI, host Craig Smith speaks with Fei Fei Li about the rise of spatial intelligence and the world models that could transform how machines perceive, imagine, and interact with reality. We explore how spatial intelligence goes beyond language to connect perception, action, and reasoning in physical environments. You will hear how models like...
info_outline
#302 Karl Friston: How the Free Energy Principle Could Rewrite AI
Eye On A.I.
This episode is sponsored by AGNTCY. Unlock agents at scale with an open Internet of Agents. Visit and add your support. How could Karl Friston’s Free Energy Principle become a blueprint for the future of AI? In this episode of Eye on AI, host Craig Smith sits down with Karl Friston, the neuroscientist behind the Free Energy Principle and advisor to Verses AI, to explore how active inference and brain inspired generative models might move us beyond transformer based systems. They unpack how Axiom, Verses’ new architecture, uses probabilistic beliefs and message passing to build...
info_outline
#301 Hemant Banavar & Ryan Paulson: The AI Safety System Driving Toward Zero Harm
Eye On A.I.
How are AI and telematics changing safety for fleets in the real world, and what does it take to get from basic recordings to true accident prevention? In this episode of Eye on AI, host Craig Smith speaks with Hemant, Chief Product Officer at Motive, and Ryan, CIO at Fusion Site Services, to explore how AI powered cameras and telematics are transforming safety, productivity, and profitability across the physical economy, from trucking and construction to field services. We look at what makes safety AI trustworthy at scale, how to reduce false alerts that drivers ignore, and how to combine...
info_outline
#300 Fred Laluyaux: How Decision Intelligence & AI Agents Are Redefining Enterprise Operations
Eye On A.I.
How are Decision Intelligence and AI agents reshaping enterprise operations today? In this episode of Eye on AI, host Craig Smith sits down with Fred Laluyaux, CEO of Aera Technology, to unpack how organizations move from dashboards and ad hoc workflows to a system that senses, decides, and acts. AI is not just about chatbots. At the heart of this transformation is decision intelligence: connecting data, analytics, AI, and automation to optimize decisions across the enterprise. Fred explains why this is becoming the operating backbone of the modern enterprise and how it accelerates the...
info_outline
#299 Jacob Buckman: Why the Future of AI Won’t Be Built on Transformers
Eye On A.I.
This episode is sponsored by AGNTCY. Unlock agents at scale with an open Internet of Agents. Visit and add your support. Why do today’s LLMs forget key details over long context, and what would it take to give them real memory that scales? In this episode of Eye on AI, host Craig Smith explores Manifest AI’s Power Retention architecture and how it rethinks memory, context, and learning for modern models. We look at why transformers struggle with long inputs, how state space and retention models keep context at linear cost, and how scaling state size unlocks...
info_outline
#298 Ryan Kolln: How Appen Trains the World’s Most Powerful AI Models
Eye On A.I.
This episode is sponsored by AGNTCY. Unlock agents at scale with an open Internet of Agents. Visit and add your support. How do the world’s most powerful AI models get trained and trusted at scale, and what does that really take from data to deployment? In this episode, Appen CEO Ryan Kolln joins Eye on AI to unpack how rigorous human evaluation, culturally aware data, and model-based judges come together to raise real-world performance. In this episode of Eye on AI, host Craig Smith speaks with Ryan Kolln, CEO of Appen, about building evaluation systems that go beyond static...
info_outline
#297 Jeff Lunsford: How Agentic AI Will Redefine Every Digital Interaction
Eye On A.I.
Why will agentic AI redefine every digital interaction, and what foundation do enterprises need to make it safe, trusted, and real time? In this episode of Eye on AI, host Craig Smith sits down with Jeff Lunsford to unpack how a neutral customer data platform like Tealium becomes the control plane for agentic systems. We cover how to collect and unify first party data responsibly, enforce consent and identity across channels, and feed the right context to models so agents can act with confidence in the moment. You will hear how real time profiles, event streams, and deterministic identity...
info_outline
#296 Yeop Lee: How Coxwave is Redefining AI Evaluation
Eye On A.I.
This episode is sponsored by AGNTCY. Unlock agents at scale with an open Internet of Agents. Visit https://agntcy.org/ and add your support. How is Coxwave Redefining AI Evaluation? In this episode of Eye on AI, host Craig Smith is joined by Yeop Lee, Head of Product at Coxwave. Together they explore how teams move beyond accuracy-only metrics to outcome focused evaluation with Coxwave’s Align. We look at how Align measures satisfaction, trust, and task completion across chat, email, and voice, how LLM as judge pairs with human review, and how product teams search conversations to...
info_outline
#295 Fergal Reid: Why Your Bots Fail and How Agents Fix Your Customer Support
Eye On A.I.
This episode is sponsored by AGNTCY. Unlock agents at scale with an open Internet of Agents. Visit https://agntcy.org/ and add your support. Why do so many chatbots fail in the real world, and how can AI agents actually fix customer support? In this episode of Eye on AI, host Craig Smith explores how teams move beyond scripted bots to production-grade AI agents that resolve real issues across chat, email, and voice. We look at what makes agents reliable at scale, how to configure them safely, and how to manage them like digital workers alongside your human team. Learn how leading...
info_outline
#294 Bhaskar Roy: How Workato Is Building the Rise of the Agentic Enterprise
Eye On A.I.
Try OCI for free at http://oracle.com/eyeonai This episode is sponsored by Oracle. OCI is the next-generation cloud designed for every workload – where you can run any application, including any AI projects, faster and more securely for less. On average, OCI costs 50% less for compute, 70% less for storage, and 80% less for networking. Join Modal, Skydance Animation, and today’s innovative AI tech companies who upgraded to OCI…and saved. How are enterprises moving from AI experiments to a true agentic enterprise with measurable ROI? In this episode of Eye on AI, host Craig...
info_outlineThis episode is sponsored by AGNTCY. Unlock agents at scale with an open Internet of Agents.
Visit https://agntcy.org/ and add your support.
How do the world’s most powerful AI models get trained and trusted at scale, and what does that really take from data to deployment?
In this episode, Appen CEO Ryan Kolln joins Eye on AI to unpack how rigorous human evaluation, culturally aware data, and model-based judges come together to raise real-world performance.
In this episode of Eye on AI, host Craig Smith speaks with Ryan Kolln, CEO of Appen, about building evaluation systems that go beyond static benchmarks to measure usefulness, safety, and reliability in production. They explore how human raters and AI evaluators work in tandem, why localization matters across regions and domains, and how quality controls keep feedback signals trustworthy for training and post-training.
Ryan explains how evaluation feeds reinforcement strategies, where rubric-driven human judgments inform reward models, and how enterprises can stand up secure workflows for sensitive use cases. He also discusses emerging needs around sovereign models, domain-specific testing, and the shift from general chat to agentic workflows that operate inside real business systems.
Learn how leading teams design human-in-the-loop evaluation, when to route judgments from models back to expert reviewers, how to capture cultural nuance without losing universal guardrails, and how to build an evaluation stack that scales from early prototypes to production AI.
Stay Updated:
Craig Smith on X: https://x.com/craigss
Eye on A.I. on X: https://x.com/EyeOn_AI