#298 Ryan Kolln: How Appen Trains the World’s Most Powerful AI Models
Release Date: 11/06/2025
#338 Amith Singhee: Can India Catch Up in AI? IBM's Amith Singhee on What It Will Take
Eye On A.I.
What if the country that trains the world's engineers finally built the infrastructure to match its talent? In this episode of Eye on AI, Craig Smith sits down with Amith Singhee, Director of IBM Research India and CTO of IBM India and South Asia, to explore where India actually stands in the global AI race and what it will take to close the gap. Amith gives an honest, ground-level assessment of why India has been slow to compete. The talent has always been there. But until recently, the investment, the compute infrastructure, and the institutional intent hadn't come together in a sustained,...
info_outline
#337 Debdas Sen: Why AI Without ROI Will Die (Again)
Eye On A.I.
What does it actually take to prove that AI delivers real value in the industries that keep the world running? In this episode of Eye on AI, Craig Smith sits down with Debdas Sen, CEO of TCG Digital and Joint Managing Director of Lummus Digital, to explore what serious enterprise AI looks like when it is applied to some of the most complex, high-stakes problems on the planet. Problems like compressing years of catalyst research into weeks, predicting refinery failures before they happen, and accelerating drug development timelines that could determine how long a life-saving medicine takes to...
info_outline
#336 Professor Mausam: Why India Is Losing the AI Race and What It Will Take to Catch Up
Eye On A.I.
What if the country that produces the world's top AI talent finally figured out how to keep it? In this episode of Eye on AI, Craig Smith sits down with Professor Mausam, one of India's leading AI researchers, AAAI Fellow, and founding head of the Yardi School of Artificial Intelligence at IIT Delhi, to get an honest and unflinching diagnosis of why India has fallen so far behind the US and China in artificial intelligence and what it will actually take to close that gap. Mausam breaks down the structural story behind India's deficit. A pipeline of world-class students that gets exported...
info_outline
#335 Sriram Raghavan: Why IBM Is Betting Everything on Small AI Models
Eye On A.I.
Why IBM Is Betting Everything on Small AI Models In this episode of Eye on AI, Craig Smith sits down with Sriram Raghavan, Vice President of AI at IBM Research, to explore one of the most important debates in enterprise AI right now. Do you actually need a massive model to get world class results? IBM's answer is no, and Sriram breaks down exactly why. Sriram explains why IBM chose to train its Granite models directly using reinforcement learning rather than distilling from larger models like most of the industry. The reason goes beyond performance. It comes down to data lineage, safety...
info_outline
#334 Abhishek Singh: The $1.2 Billion Plan to Turn India Into an AI Superpower
Eye On A.I.
What if the country that trained the world's engineers finally decided to keep them? In this episode of Eye on AI, Craig Smith sits down with Abhishek, the civil servant leading India's $1.2 billion national AI Mission, to explore how one of the world's largest and most diverse nations is mounting a serious challenge to US and Chinese dominance in artificial intelligence. Abhishek breaks down the honest story behind India's late start. World-class talent, but no research ecosystem to retain it. Digitization without AI-usable data. Compute so scarce that the entire country had fewer than 500...
info_outline
#333 Adi Kuruganti: Why Your AI Pilot Is Failing and What It Takes to Reach Production
Eye On A.I.
Most enterprises are excited about agentic AI. But very few are actually deploying it in production. In this episode of Eye on AI, Craig Smith sits down with Adi Kuruganti, Chief AI and Development Officer at Automation Anywhere, to break down why agentic AI is so hard to get right in the enterprise and what it actually takes to move from a promising pilot to a mission-critical deployment. Adi explains why the future of enterprise automation is not agentic AI alone, but the combination of deterministic and agentic systems working together, and why companies that treat AI as a technology...
info_outline
#332 Dan Faulkner: The Code Is Clean. The App Is Broken. Why AI Development Has an Integrity Problem
Eye On A.I.
What happens when AI writes code faster than anyone can test it? In this episode of Eye on AI, Craig Smith sits down with Dan Faulkner, CEO of SmartBear, to explore one of the most underappreciated risks of the AI coding boom. As tools like Claude Code and Codex push software development to unprecedented speed, the systems built to validate that software are being left behind. Dan makes a distinction that every engineering leader needs to hear: clean code passing unit tests is not the same as an application that actually works. Dan introduces the concept of application integrity, continuous...
info_outline
#331 Sergey Levine: The Robot Revolution Nobody Is Talking About
Eye On A.I.
This episode is sponsored by Modulate. Most voice AI focuses on transcription. Velma takes it further by actually understanding conversations, analyzing tone, timing, stress, and intent using its Ensemble Listening Model architecture. Explore the live preview: What does it actually mean to build a foundation model for robots? In this episode of Eye on AI, Craig Smith sits down with Sergey Levine, co-founder of Physical Intelligence and professor at UC Berkeley, to explore a fundamentally different approach to building robots, one inspired not by programming a single perfect machine, but...
info_outline
#330 Sebastian Risi: Why AI Should Be Grown, Not Trained
Eye On A.I.
AI has been trained like software. But what if it should be grown like life? In this episode of Eye on AI, Craig Smith sits down with Sebastian Risi, professor and leading researcher in neuroevolution and artificial life, to explore a fundamentally different approach to building intelligence, one inspired by how nature evolves, grows, and adapts. Sebastian explains why traditional AI systems are limited by fixed architectures and one-time training, and how evolutionary algorithms can create systems that continuously learn, self-organize, and even grow their own neural structures over time....
info_outline
#329 Izhar Medalsy: How AI Solves Quantum Computing’s Biggest Problem
Eye On A.I.
Quantum computing has been “5 years away” for decades. So what’s actually holding it back? In this episode of Eye on AI, Craig Smith sits down with Izhar Medalsy, Co-founder & CEO of Quantum Elements, to break down the real bottleneck in quantum computing today and why the future of the industry may depend more on classical systems and AI than quantum hardware itself. Izhar explains how digital twins of quantum systems are being used to simulate real hardware, generate massive amounts of training data, and solve one of the biggest challenges in the field: noise and error...
info_outlineThis episode is sponsored by AGNTCY. Unlock agents at scale with an open Internet of Agents.
Visit https://agntcy.org/ and add your support.
How do the world’s most powerful AI models get trained and trusted at scale, and what does that really take from data to deployment?
In this episode, Appen CEO Ryan Kolln joins Eye on AI to unpack how rigorous human evaluation, culturally aware data, and model-based judges come together to raise real-world performance.
In this episode of Eye on AI, host Craig Smith speaks with Ryan Kolln, CEO of Appen, about building evaluation systems that go beyond static benchmarks to measure usefulness, safety, and reliability in production. They explore how human raters and AI evaluators work in tandem, why localization matters across regions and domains, and how quality controls keep feedback signals trustworthy for training and post-training.
Ryan explains how evaluation feeds reinforcement strategies, where rubric-driven human judgments inform reward models, and how enterprises can stand up secure workflows for sensitive use cases. He also discusses emerging needs around sovereign models, domain-specific testing, and the shift from general chat to agentic workflows that operate inside real business systems.
Learn how leading teams design human-in-the-loop evaluation, when to route judgments from models back to expert reviewers, how to capture cultural nuance without losing universal guardrails, and how to build an evaluation stack that scales from early prototypes to production AI.
Stay Updated:
Craig Smith on X: https://x.com/craigss
Eye on A.I. on X: https://x.com/EyeOn_AI