AI Testing LLMs & RAG: What Testers Must Validate with Imran Ali
TestGuild Automation Testing Podcast
Release Date: 12/21/2025
Locust Performance Testing with AI and Observability with Lars Holmberg
TestGuild Automation Testing Podcast
Performance testing often fails for one simple reason: teams can’t see where the slowdown actually happens. In this episode, we explore Locust load testing and why Python-based performance testing is becoming the go-to choice for modern DevOps, QA, and SRE teams. You’ll learn how Locust enables highly realistic user behavior, massive concurrency, and distributed load testing — without the overhead of traditional enterprise tools. We also dive into: Why Python works so well for AI-assisted load testing How Locust fits naturally into CI/CD and GitHub Actions The real difference between...
info_outline
Top 8 Automation Testing Trends for 2026 with Joe Colantonio
TestGuild Automation Testing Podcast
AI testing is everywhere — but clarity isn’t. In this episode, Joe Colantonio breaks down the real test automation trends for 2026, based on data from 40,000+ testers, 510 live Q&A questions, and 50+ interviews with industry leaders. This isn’t vendor hype or futuristic speculation. It’s what working testers are actually worried about — and what they’re doing next. You’ll learn: Why 72.8% of testers prioritize AI, yet don’t trust it alone The real reason AI testing feels harder instead of easier How integration chaos is blocking automation success Why “AI auditor” and...
info_outline
Automation Testing Podcast 2026: New Schedule, Events, Discounts with Joe Colantonio
TestGuild Automation Testing Podcast
This is a special end-of-year episode of the Automation Testing Podcast. With family in town and a busy holiday season, Joe didn’t want to skip a week without checking in and saying thank you to the TestGuild community. In this short episode, Joe shares: A huge milestone as the podcast approaches its 13-year anniversary Why the Automation Testing Podcast is moving from Sundays to Tuesdays starting in 2026 How loyal listeners can still get $100 off a full 5-day Automation Guild 2026 pass A sneak peek at TestGuild IRL — live, in-person events coming next year Gratitude for the listeners,...
info_outline
AI Testing LLMs & RAG: What Testers Must Validate with Imran Ali
TestGuild Automation Testing Podcast
AI is transforming how software is built, but testing AI systems requires an entirely new mindset. Don't miss AutomationGuild 2026 - Register Now: Use code TestGuildPod20 to get 20% off your ticket. In this episode, Joe Colantonio sits down with Imran Ali to break down what AI testing really looks like when you’re dealing with LLMs, RAG pipelines, and autonomous QA workflows. You’ll learn: Why traditional pass/fail testing breaks down with LLMs How to test non-deterministic AI outputs for consistency and accuracy Practical techniques for detecting hallucinations, grounding...
info_outline
AI Codebase Discovery for Testers with Ben Fellows
TestGuild Automation Testing Podcast
What if understanding your codebase was no longer a blocker for great testing? Most testers were trained to work around the code — clicking through UIs, guessing selectors, and relying on outdated docs or developer explanations. In this episode, Playwright expert Ben Fellows flip that model on its head. Using AI tools like Cursor, testers can now explore the codebase directly — asking questions, uncovering APIs, understanding data relationships, and spotting risk before a single test is written. This isn’t about becoming a developer. It’s about using AI to finally see how the system...
info_outline
Gatling Studio: Start Performance Testing in Minutes (No Expertise Required) with Shaun Brown and Stephane Landelle
TestGuild Automation Testing Podcast
Performance testing has traditionally been one of the hardest parts of QA,slow onboarding, complex scripting, difficult debugging, and too many late-stage surprises. Try Gatling Studio for yourself now: https://links.testguild.com/gatling In this episode, Joe sits down with Stéphane Landelle, creator of Gatling, and Shaun Brown to explore how Gatling is reinventing the load-testing experience. You’ll hear how Gatling evolved from a developer-first framework into a far more accessible platform that supports Java, Kotlin, JavaScript/TypeScript, and AI-assisted creation. We break down the...
info_outline
AI-Driven Manual Regression: Test Only What Truly Matters With Wilhelm Haaker and Daniel Garay
TestGuild Automation Testing Podcast
Manual regression testing isn’t going away—yet most teams still struggle with deciding what actually needs to be retested in fast release cycles. See how AI can help your manual testing now: https://testguild.me/parasoftai In this episode, we explore how Parasoft’s Test Impact Analysis helps QA teams run fewer tests while improving confidence, coverage, and release velocity. Wilhelm Haaker (Director of Solution Engineering) and Daniel Garay (Director of QA) join Joe to unpack how code-level insights and real coverage data eliminate guesswork during regression cycles. They walk...
info_outline
Top Automation Guild Survey Insights for 2026 with Joe Colantonio
TestGuild Automation Testing Podcast
Automation Guild turns 10 this year, and the 2026 survey revealed some of the strongest trends and signals the testing community has ever shared. Register now: In this episode, Joe breaks down the most important insights shaping Automation Guild 2026 and what they mean for testers, automation engineers, and QA leaders. You’ll hear why AI-powered testing is dominating every category, why Playwright has officially become the tool testers want most, the challenges that continue to follow teams year after year, and how testers are navigating shrinking teams, faster releases, and rising...
info_outline
Testing AI Vibe Coding: Stop Vulnerabilities Early with Sarit Tager
TestGuild Automation Testing Podcast
AI is accelerating software delivery, but it’s also introducing new security risks that most developers and automation engineers never see coming. In this episode, we explore how AI-generated code can embed vulnerabilities by default, how “vibe coding” is reshaping developer workflows, and what teams must do to secure their pipelines before bad code reaches production. You’ll learn how to prompt more securely, how guardrails can stop vulnerabilities at generation time, how to prioritize real risks instead of false positives, and how AI can be used to protect your applications just as...
info_outline
4 Free TestGuild Tools Every Tester Should Be Using with Joe Colantonio
TestGuild Automation Testing Podcast
In this solo episode, Joe Colantonio shares four powerful free TestGuild tools designed to help testers, automation engineers, and QA leaders work smarter. Discover how to instantly find the right testing tool for your team, assess automation risk, check your site’s accessibility, and benchmark your automation maturity — all in one session. Whether you’re looking to improve test coverage, adopt better practices, or simply save time, these tools were built with you in mind. What You’ll Learn: – How to choose the right test automation tool fast – How to identify and reduce testing...
info_outlineAI is transforming how software is built, but testing AI systems requires an entirely new mindset.
Don't miss AutomationGuild 2026 - Register Now: https://testguild.me/podag26
Use code TestGuildPod20 to get 20% off your ticket.
In this episode, Joe Colantonio sits down with Imran Ali to break down what AI testing really looks like when you’re dealing with LLMs, RAG pipelines, and autonomous QA workflows.
You’ll learn:
Why traditional pass/fail testing breaks down with LLMs
How to test non-deterministic AI outputs for consistency and accuracy
Practical techniques for detecting hallucinations, grounding issues, and prompt injection risks
How RAG systems change the way testers validate AI-powered applications
Where AI delivers quick wins today—and where human validation still matters
This conversation goes beyond hype and gets into real-world AI testing strategies QA teams are using right now to keep up with AI-generated code, faster release cycles, and DevOps velocity.
If you’re a tester, automation engineer, or QA leader wondering how AI changes your role,not replaces it,this episode is your roadmap.