AI Education Podcast
Dan Bowen and Ray Fleming are experienced education renegades who have worked in many various educational institutions and educational companies across the world. They talk about Artificial Intelligence in Education - what it is, how it works, and the different ways it is being used. It's not too serious, or too technical, and is intended to be a good conversation. Please note the views on the podcast are our own or those of our guests, and not of our respective employers (unless we say otherwise at the time!)
info_outline
S10 E11 AI Podcast Wrapped for 2024
12/20/2024
S10 E11 AI Podcast Wrapped for 2024
We look back on the highlights of 2024, and the mass of stories, challenges and inspirations we had throughout the year. And what a year - AI in education has been moving so fast we even invited two digital AI podcasters to take over half the episode. And, worryingly, they did an amazing job - listen for yourself... We're going to take a break over the Australian school holidays, but then we'll be back with at the end of January 2025. If you miss us, then please go and give us a rating or review in Spotify or Apple Podcasts, and that'll encourage us to return with even more energy for 2025! We mention far too many stories and episodes to list them all, but one thing we mentioned a few times are the top five episodes from 2024, which in chronological order are: Assessment and Swiss Cheese - Phill Dawson - Episode 9 of Series 9 From Burnout to Breakthrough: Amanda Bickerstaff on AI's Role in Education Jason Lodge - Guiding Through Assessments University of Sydney and the future of assessment Is AI the saviour of teaching? Leanne Cameron's perspective on AI across the teaching profession
/episode/index/show/aiineducationpodcast/id/34544810
info_outline
AI News (and no research!)
12/13/2024
AI News (and no research!)
A heap of news stories this week means we didn't cover any research at all! AI isn’t a tool, it’s an environment by Josh Thorpe Australian Senate report into Adoption of AI Ethan Mollick's course on Coursera: "AI in Education: Leveraging ChatGPT for Teaching" I'll also recommend his book - Co-Intelligence - as a great Christmas gift for yourself or a friend Open AI announced Open AI Pro @ $200/m We like Ethan Mollick's example that showed what it could do - solving this problem and creating a working app in 15 minutes - see here: Microsoft Copilot with vision for consumers Demo example: Sora released ChatGPT's Advanced Voice Mode finally gets visual context on the 6th day of OpenAI Apple released iOS 18.2 with integrated AI Google Gemini 2.0 with real time speech and vision We're on Bluesky "The Carbon Emissions of Writing and Illustrating Are Lower for AI than for Humans" Microsoft's Zero-Water Solution for Data Centre Cooling
/episode/index/show/aiineducationpodcast/id/34426475
info_outline
S10 E9 - TEQSA AI Toolkit
12/05/2024
S10 E9 - TEQSA AI Toolkit
This week's episode discussed the new AI toolkit for generative AI strategies from Australia's Higher Education regulator, The full toolkit is available here: During the episode we referenced some of the podcasts when we'd had the chance to interview some of the people from The University of Sydney who were used as case studies in the toolkit, and here's the link to previous podcast episodes that might be helpful to go back to for more depth: The University of Sydney's Cogniti AI bot The University of Sydney's Two Lane approach to assessment We'd also recommend listening to conversations with two leaders on post-AI assessment Jason Lodge at the University of Queensland Phill Dawson at the CRADLE centre at Deakin University
/episode/index/show/aiineducationpodcast/id/34260740
info_outline
Everybody or Nobody is using AI - News and Research
11/28/2024
Everybody or Nobody is using AI - News and Research
Everybody or Nobody is using AI - News and ResearchSeries 10, Episode 8 We explore quite a lot of news related to AI in Education that arrived this week, which meant we didn't get to cover nearly as many academic research papers as we'd hoped. Oh well, there's still 4 episodes left this year to catch up 😊 News Open AI released a course for teachers The AI Art Turing Test Overview: Direct link to the Avoiding the Discriminatory Use of Artificial Intelligence Brisbane Catholic Education's announcement on "AI for everybody" New research from Google Workspace and The Harris Poll shows rising leaders are embracing AI to drive impact at work TEQSA Paper on GenAI Strategies for Higher Education Research Unipa-GPT: Large Language Models for university-oriented QA in Italian Boosting Large Language Models with Socratic Method for Conversational Mathematics Teaching LessonPlanner: Assisting Novice Teachers to Prepare Pedagogy-Driven Lesson Plans with Large Language Models Automated Educational Question Generation at Different Bloom's Skill Levels using Large Language Models: Strategies and Evaluation Could ChatGPT get an Engineering Degree? Evaluating Higher Education Vulnerability to AI Assistants
/episode/index/show/aiineducationpodcast/id/34190840
info_outline
AI - Study Buddy or Influencer? Series 10, Episode 7
11/21/2024
AI - Study Buddy or Influencer? Series 10, Episode 7
This week's episode is a discussion of the Australian Parliamentary report on AI in Education, "". The report highlights both the opportunities and challenges GenAI presents, focusing on student and teacher perspectives, ethical considerations, regulatory approaches, and potential solutions. The report makes many recommendations, with the very first being significant on many levels: "The Committee recommends that the Australian Government: consider making the use of GenAI in education a national priority" and are joined by guest, , an Education Consultant for Generative AI for the and also Marketing & Events Coordinator for the . Miriam was previously Head of Digital Education at Hillbrook Anglican School, and has produced a number of resources for teachers that she shares on her personal website "" An for anyone looking to integrate generative AI in their school for education An for teachers
/episode/index/show/aiineducationpodcast/id/33990177
info_outline
Deception and Deepfakes - News & Research
11/15/2024
Deception and Deepfakes - News & Research
Another News & Research episode this week, and lots of interesting links and research discussed. Here's the weblinks for everything! News Deception and Deepfakes - How genAI is Changing Cyber Safety Course: Leon Furzes online course, where he made a free course about deepfakes hosted by a deepfake, with deepfake content about deepfakes McKinsey surveyed 1363 working professionals across countries, industries, and demographics about the use of generative AI at their work places. The Carbon Emissions of Writing and Illustrating Are Lower for AI than for Humans Satya Nadella shared 200 examples globally of companies using AI Rose Luckin's Beyond the Hype report Brad Smith shares a Digital Twin of St Peters Basilica in Rome Research Spotting Research Fraud - a website that's fascinating AI or Human? Evaluating Student Feedback Perceptions in Higher Education Teacher Learning Network Journal - AI in Education special Adoption and Impact of ChatGPT in Computer Science Education: A Case Study on a Database Administration Course Follow-Up Questions Improve Documents Generated by Large Language Models Educational Personalized Learning Path Planning with Large Language Models
/episode/index/show/aiineducationpodcast/id/33941277
info_outline
AI for AussieEd week, with Toddle
11/07/2024
AI for AussieEd week, with Toddle
In September, the team organised "", a week-long series of professional development sessions for teachers, which had thousands of attendees for the virtual sessions. This episode "Driving Innovation in Australian Schools" was part of the week, and brings you the experiences of three educators, in conversation with podcast hosts Dan and Ray The guests are: , Primary School Learning Leader at Concordia College in Adelaide , Director of Digital Pedagogies & Online Safety Education at the ACT Education Directorate , Director of Learning Technologies and ICT at St Michaels Grammar School in Melbourne It was a great discussion, and because it was recorded as a live webinar, we had lots of audience questions coming in online, so in the second half of the episode, you're going to hear questions coming in the chat from live listeners. As usual, hosts Dan and Ray brought along their own contributions to the discussion: came with his deep pedagogical knowledge and insightful education conversation. brought his Buzzword Bingo card
/episode/index/show/aiineducationpodcast/id/33770837
info_outline
Research - How are students using AI - Series 10 Episode 4
10/31/2024
Research - How are students using AI - Series 10 Episode 4
This week's episode has a lot more news than research. But the research that we spend a bit of time on is the insights on how students in Australian universities are using AI. Really good insights for any educator or leader! News AI Detectors Falsely Accuse Students of Cheating—With Big Consequences Empowering Education Leaders Toolkit TEQSA Guidance for universities Danny Liu video Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said More than a quarter of new code at Google is generated by AI - The Verge Apple are launching their first devices with Apple Intelligence Watch out for the Earning reports: Google just released and Microsoft do this week too. Always have a listen to these to find out about the momentum in AI. Research A Systematic Mapping Review at the Intersection of Artificial Intelligence and Self-Regulated Learning A call for increased theoretical grounding focus on motivation and diversifying context Students perspectives on AI in higher education Project website: Survey highlights: Guidance for students: Guidance for academics:
/episode/index/show/aiineducationpodcast/id/33680227
info_outline
Anna Denejkina - Insight Centre
10/24/2024
Anna Denejkina - Insight Centre
Series 10, Episode 3 This week's episode is an interview with , who's an interdisciplinary researcher and Associate Director at . We discuss her research on youth engagement with generative AI. The conversation explores the multifaceted impact of AI technology in education, addressing benefits such as upskilling and accessibility, as well as concerns related to academic misconduct, job displacement, and misinformation. Key themes include gender disparity in confidence using AI, the importance of critical and empathetic thinking, and the evolving landscape of education assessments. The dialogue also highlights issues of loneliness, anxiety, and the growing equity gap driven by differences in AI adoption across various educational institutions. Anna talks about her previous research on Young People's Perception and Use of Generative AI, which is a collaboration between The Insight Centre and YouthInsight. Here's , and the We also mentioned the You can find all of Anna's research publications
/episode/index/show/aiineducationpodcast/id/33532927
info_outline
AI Research - Apostles, Agnostics and Atheists
10/17/2024
AI Research - Apostles, Agnostics and Atheists
This week we cover a range of AI in Education related news and academic research papers. Here's all the links you need to read more about each of the topics we dicussed: News Australia's Voluntary AI Safety Standard In September the Australian Government published: Voluntary AI Safety Standard (68pg): Proposals paper for introducing mandatory guardrails for AI in high-risk settings: Stanford's STORM Students give English HSC exam an F over use of image with ‘hallmarks’ of AI Investigation into the use of ChatGPT by a Child Protection worker - Office of the Victorian Information Commissioner Research Papers To what extent is ChatGPT useful for language teacher lesson plan creation? Have We Reached AGI? Comparing ChatGPT, Claude, and Gemini to Human Literacy and Education Benchmarks The Life Cycle of Large Language Models: A Review of Biases in Education The Future of Learning: Large Language Models through the Lens of Students How to Mitigate the Dependencies of ChatGPT-4o in Engineering Education StuGPTViz: A Visual Analytics Approach to Understand Student-ChatGPT Interactions Apostles, Agnostics and Atheists: Engagement with Generative AI by Australian University Staff
/episode/index/show/aiineducationpodcast/id/33493577
info_outline
AI robots taking podcasters' jobs?
10/11/2024
AI robots taking podcasters' jobs?
Welcome to the first Episode of Series 10, where we are going to take some time to review some of the fundamental changes we're going to be seeing as AI becomes more pervasive. In this Episode we're taking a different approach, with and using Google's NotebookLM to create AI-delivered mini-podcasts about each other, which leads to a discussion about the backgrounds of both hosts, and a discussion about how this new AI might be used in education. Obviously, both Dan and Ray conclude that AI won't replace them...yet! For your own experiments, you can find NotebookLM at The two mini podcasts in this episode were produced by simply feeding NoteBookLM with the hosts LinkedIn profiles (in PDF format - available as a download from any individual's LinkedIn page). We'd love to hear how you're using NotebookLM, and other AI tech, in your work. The easiest way to get hold of us is via our LinkedIn page And if you're enjoying the podcast, would now be a good time to leave a review in your podcast app - whether you're using Apple Podcasts, Google Podcasts or Spotify, we'd love it if you left a rating and review.
/episode/index/show/aiineducationpodcast/id/33385582
info_outline
South Australia's EdChat - Series 9 Episode 12
10/03/2024
South Australia's EdChat - Series 9 Episode 12
This week we're joined by the brains behind South Australia's EdChat chatbot. It was the first state in Australia to start pilot a custom built generative AI chatbot for their schools, and we spent some time with the team to understand the success story. In the podcast, we heard from (Director of Digital Architecture and Operations) and (AI Technical specialist), both from the Department for Education South Australia Find out more about the South Australia Department AI approach: and details on their trial - Microsoft have written a case study on their News Centre here: Video of their amazing work: 9 News report : AI Safety - Towards the end of the episode we also talked about Career chat:
/episode/index/show/aiineducationpodcast/id/33311682
info_outline
Happy 5th Anniversary to AI in Education
09/26/2024
Happy 5th Anniversary to AI in Education
Unbelievably, it's our 5th Anniversary (AI-nniversary?) and to mark the milestone of an AI podcast that's had more pivots than a robot's legs, and more chat than a chatbot, we've pulled together some of the top episodes from the 108 episodes of the podcast so far, and got the band back together (regretfully, we were unable to persuade Beth Worral, who co-hosted in 2022-2023, to come back for our party podcast - she'd reached escape velocity), so you'll hear Dan, Ray and Lee reminiscing like old men in a shed. Great Guests & Top Episodes Our very first guest - Microsoft's Troy Waller in in 2019 Our most listened episode from 2019 and very first external guest - the brilliant Dr David Kellerman in Our top 2020 episode was , which looked backin to the human obsession with creating artificial replicas of themselves. When did it start, who started it, what is the AI winter and how did it accelerate so quickly in the last 10 years. (And even faster in the last 4 years since?) In 2021, another great guest topped our episode charts, with as Sly talked about his work around VR and AR and the mergeing of physical and virtual worlds For 2022, it was the Christmas edition that hit the heights, with all four co-hosts - Beth, Lee, Dan & Ray - together for the quizzically named By 2023, we were back on solid pedagogy again, with the episode (the kind of title a marketing manager would love?) And, although we've not yet reached the end of 2024 and we've got some great episodes ahead, the top episode this far is with Danny Liu and Adam Bridgman We also had fond memories of: The episode from 2020 Martin O'Sullivan's tales from Turing House School in Elle Graham (aka Woodes) in Practical lessons from chatbot land with , with the stories shared by Dan Hart and Michelle Michael
/episode/index/show/aiineducationpodcast/id/33215237
info_outline
More Comp Sci research! News and Research - Episode 10 of Series 9
09/20/2024
More Comp Sci research! News and Research - Episode 10 of Series 9
News This week's news we rushed through includes "Study Buddy or Influencer?", the Australian Parliamentary Inquiry into the use of Gen AI in the Australia Education System NSW EduChat has been extended for all teachers in all New South Wales Schools - Learn more about the Microsoft announced Copilot Wave 2 OpenAI's new model o1-preview came out - and it's much, much better and logical reasoning and maths Find out what people think by looking at what (and, as I suggest on the podcast, keenly watch as he's benchmarking it now in the context of EduChat) Google released a podcast-generator as part of NotebookLM, which turns any kind of paper/book etc into a short podcast. To find out what it's like and you can compare it versus me! There's a quick demo review by and you can login and have a play directly here: (it has two main uses, because on top of this autopodcast, it's original purpose was to allow you give it a pile of documents and it can work with all of them at the same time for q&a, summaries etc) Research Here's the links to all nine papers we discussed in this week's episode: Generative AI in Real-World Workplaces Can Large Language Models Make the Grade? PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection The global landscape of academic guidelines for generative AI and Large Language Models "Is ChatGPT a Better Explainer than My Professor?": Evaluating the Explanation Capabilities of LLMs in Conversation Compared to a Human Baseline Perceived Impact of Generative AI on Assessments: Comparing Educator and Student Perspectives in Australia, Cyprus, and the United States Jill Watson: Scaling and Deploying an AI Conversational Agent in Online Classrooms Integrating AI in College Education: Positive yet Mixed Experiences with ChatGPT The AI Companion in Education: Analyzing the Pedagogical Potential of ChatGPT in Computer Science and Engineering
/episode/index/show/aiineducationpodcast/id/33119802
info_outline
Assessment and Swiss Cheese - Phill Dawson - Episode 9 of Series 9
09/12/2024
Assessment and Swiss Cheese - Phill Dawson - Episode 9 of Series 9
This week's guest is Professor Phillip Dawson, who is Co-Director of the at Deakin University in Australia. In addition to , we recommend following Phill on , or , where shares a lot of his work on the future of assessment, and also his passion project - The Peer Revue - where Phill combines his passion for academic research with his work in Improv Comedy. Every month he hosts a research who talks about their professional research, which is then turned into comedy gold by his improv team at (highly recommend keeping an eye out for this if you're in Melbourne) You can , and his LinkedIn feed has his books and his contributions to other advice and consultations in the education sector Phil mentions a number of researchers and their work in the podcast. Here's the links: James Reason's work on the Swiss Cheese model for failure of complex systems "The contribution of latent human failures to the breakdown of complex systems" You can either read the or this easier to Kiata Rundle's work on then applying this to academic integrity - Alfie Kohn "Punished by Rewards" - Phill mentioned Deci & Ryan's work, And here's a Then Phill mentioned the book
/episode/index/show/aiineducationpodcast/id/33002832
info_outline
Research - Homework and Sex
09/05/2024
Research - Homework and Sex
Series 9, Episode 9 - Homework and Sex News How do people actually use ChatGPT? Make AI tools to reduce teacher workloads, tech companies urged New AI in Teams - and it's all free Research Papers Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classrooms Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Exam Generative AI Can Harm Learning ChatGPT, Copilot, Gemini, SciSpace and Wolfram versus higher education assessments: an updated multi-institutional study of the academic integrity impacts of Generative Artificial Intelligence (GenAI) on assessment, teaching and learning in engineering How critically can an AI think? A framework for evaluating the quality of thinking of generative artificial intelligence Analyzing Large Language Models for Classroom Discussion Assessment Student Perspectives on Using a Large Language Model (LLM) for an Assignment on Professional Ethics ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictor 70B-parameter large language models in Japanese medical question-answering I don't trust you (anymore)! -- The effect of students' LLM use on Lecturer-Student-Trust in Higher Education Large Language Models in Student Assessment: Comparing ChatGPT and Human Graders
/episode/index/show/aiineducationpodcast/id/32907607
info_outline
Series 9 Episode 7 - Rose Luckin - Satnav for the mind?
08/29/2024
Series 9 Episode 7 - Rose Luckin - Satnav for the mind?
This week we hear from , from and In the podcast, Rose mentioned the 1% project in Finland from 2020 - Through Educate Ventures Research there are a range of AI consultancy and training services for schools, including the Rose also has a monthy newsletter "" which has an extensive reading list every edition, on a number of AI topics, not just what's happening in education.
/episode/index/show/aiineducationpodcast/id/32756507
info_outline
Series 9 Episode 6 - News and Research - Academic Integrity again...
08/22/2024
Series 9 Episode 6 - News and Research - Academic Integrity again...
News TEQSA's new paper on Academic Integrity & AI The evolving risk to academic integrity posed by generative artificial intelligence: Options for immediate action State of Generative AI in the Enterprise: An Australian Perspective Research A review on the use of large language models as virtual tutors Jill Watson: A Virtual Teaching Assistant powered by ChatGPT An empirical study to understand how students use ChatGPT for writing essays and how it affects their ownership Intelligent Tutor: Leveraging ChatGPT and Microsoft Copilot Studio to Deliver a Generative AI Student Support and Feedback System within Teams Large Language Models as Partners in Student Essay Evaluation Grade Like a Human: Rethinking Automated Assessment with Large Language Models Designing Prompt Analytics Dashboards to Analyze Student-ChatGPT Interactions in EFL Writing Experiences from Integrating Large Language Model Chatbots into the Classroom Delving into ChatGPT usage in academic writing through excess vocabulary Understanding Students' Acceptance of ChatGPT as a Translation Tool: A UTAUT Model Analysis
/episode/index/show/aiineducationpodcast/id/32706227
info_outline
From Pod to Stage - Where to Find Dan and Ray Next
08/17/2024
From Pod to Stage - Where to Find Dan and Ray Next
BONUS EPISODE ! We'd love to meet more of our listeners in person, so here's a list of events over the next few weeks when Dan, Ray, or Dan and Ray are speaking about AI in Education. One of the things that makes the podcast special is the amazing stories we get from our guests, and there's more stories than fit into an episode, and we're always on the lookout for more. So come and say hi at any of these events, and per haps we can share an untold story, or you can tell us yours! August 19 August - Melbourne - Ray Ray's on the panel discussing "The Transformed Learning Landscape Through AI" at this event for edtech companies and universities 21 August - Sydney - Ray - Free event If you're in Sydney, the has scheduled the perfect event on Wednesday evening (starting at 6PM). Ray's hosting the free learning session "The Future of Human AI", designed for the thousands of small businesses and employees around Western Sydney who want to make sense of the AI hype and start to understand what everybody else is talking about. If you're a teacher, you'll also walk away with some good ideas of how businesses are using AI to help with your discussion of AI in the classroom 23 August - Sydney - Dan Organised by friends of the podcast Matt Esterman and Nick Jackson at WSU's Parramatta campus, it'll be a festival of ideas from a great lineup of teachers. Dan's one of the speakers, and will be wearing his Microsoft badge on the day, talking about all the latest great tech announcements from that world. September 3 September - Online - Dan - Free event Build a Bot in Copilot Studio Doing his day job, Dan's taking part in this online workshop designed to help Microsoft Copilot users build their own bot. Like Build a Bear workshop, but with less bear and more bot. Open to any Microsoft customers in Australia and New Zealand. 4 September - Christchurch, NZ - Ray For New Zealand listeners Ray's heading over the ditch to deliver a keynote called "AI, why?" at the annual conference for digital teams of universities and polytechnics. If you're going to be there, please say Hi! 12-13 September - Adelaide - Ray Ray's taking part in the "Marketing, Recruitment, Advancement and AI in Higher Education Conference" in Adelaide. Ray's on a panel discussion "The place of AI in university " with Eddie Major, on applications of AI beyond teaching and learning, and then delivering the closing keynote, grandly titled "The future of HE - The future of higher education in a world where gen AI is ubiquitous" 16-19 September - Online - Dan and Ray - Free event The toddle team have pulled together 20 speakers from across Australia, who will be talking about assessment, LMSs, chatbots, the AI Framework for schools, leadership and data-driven learning. And tacked on right at the end of the run, at 5:15 on the 19th, we're going to have a crack at a live podcast recording
/episode/index/show/aiineducationpodcast/id/32600797
info_outline
From Burnout to Breakthrough: Amanda Bickerstaff on AI's Role in Education
08/15/2024
From Burnout to Breakthrough: Amanda Bickerstaff on AI's Role in Education
In this episode of the AI in Education podcast, hosts Dan and Ray welcome Amanda Bickerstaff, an experienced educator, keynote speaker, researcher, and founder of AI for Education. Amanda shares her journey from traditional teaching to embracing AI during her time in Australia and the US. She explains the transformative potential of generative AI in creating rubrics and personalizing learning while highlighting the current limitations and necessary steps toward adoption. Amanda advocates for building AI literacy, addressing teacher fears and misconceptions, and embracing creativity. The discussion also explores the future of AI in education, particularly in personalised tutoring, and the importance of understanding biases and data privacy. Amanda emphasises meeting educators where they are and the potential of AI in saving time and enhancing teaching practices. Amanda's LinkedIn Profile: AI for Education site: AI prompt library: Webinar archive: Free resources for teachers: 00:00 Guest Introduction: Amanda Bickerstaff 01:17 Amanda's Background and Journey 02:53 The Role of AI in Education 04:56 Challenges and Misconceptions in AI Adoption 06:05 Building AI Literacy and Addressing Fears 12:51 The Future of Personalised Learning 22:13 Exciting Developments and Final Thoughts 30:29 Conclusion and Closing Remarks
/episode/index/show/aiineducationpodcast/id/32571662
info_outline
"AI Is Here to Help, Not to Replace Anybody" says Researcher - Series 9 Episode 3
08/08/2024
"AI Is Here to Help, Not to Replace Anybody" says Researcher - Series 9 Episode 3
Holy smokes, we missed the party that should have been Episode 100! So now we're going to have a belated party episode later. Oh well, this week's episode is not to be stopped, so yet again Dan and Ray discuss the most interesting research on the use of AI in Education from the recent publications. But before that we started with a quick news summary. All the links are here: News California’s proposed law against AI replacing human professors Animated AI Teaching Assistants Coming to Morehouse Khanmigo for all! Sign up for Khanmigo for Teachers in English: Open AI Research Papers SUMMATIVE EXAMS WITH THE USE OF CHATGPT: VISION OR REALISTIC ALTERNATIVE TO TRADITIONAL EXAMS? Note that this paper is one of the few that I'll flag that's behind a journal paywall. If you don’t have access, I'd suggest asking the author, , if he's happy to share a copy The great detectives: humans versus AI detectors in catching large language model-generated medical writing Jae Q. J. Liu, Kelvin T. K. Hui, Fadi Al Zoubi, Zing Z. X. Zhou, Curtis C. H. Yu, Jeremy R. Chang, Arnold Y. L. Wong - The Hong Kong Polytechnic University Dino Samartzis, Rush University Medical Center Leveraging Large Language Model as Simulated Patients for Clinical Education Yanzeng Li1 , Cheng Zeng2,3 , Jialun Zhong1 , Ruoyu Zhang1 , Minhao Zhang1 , Lei Zou1∗ 1Wangxuan Institute of Computer Technology, Peking University 2School of Computer Science, Wuhan University. 3CureFun Co. Automated Assessment of Encouragement and Warmth in Classrooms Leveraging Multimodal Emotional Features and ChatGPT "ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses Bruno Pereira Cipriano and Pedro Alves Lusofona University, COPELABS, Lisbon, Portugal Math Multiple Choice Question Generation via Human-Large Language Model Collaboration Jaewook Lee, Andrew Lan - University of Massachusetts Amherst Digory Smith, Simon Woodhead - Eedi ChatGPT in Data Visualization Education: A Student Perspective Nam Wook Kim, Grace Myers - Boston College; Hyung-Kwon Ko - KAIST; Benjamin Bach - INRIA A Careful Examination of Large Language Model Performance on Grade School Arithmetic Automated Generation of High-Quality Medical Simulation Scenarios Through Integration of Semi-Structured Data and Large Language Models Scott Sumpter CHSOS, Canadian Surgical Technology and Advanced Robotics, London Health Sciences Centre Outsmarting Artificial Intelligence in the Classroom—Incorporating Large Language Model-Based Chatbots into Teaching Juliane Wutzler, Worms University of Applied Sciences University Students’ Self-Reported Reliance on ChatGPT for Learning: a Latent Profile Analysis Ana Stojanov, Qian Liu , Joyce Hwee Ling Koh - University of Otage
/episode/index/show/aiineducationpodcast/id/32495737
info_outline
Anthony England - Building a Community of Learning Series 9 Episode 2
08/01/2024
Anthony England - Building a Community of Learning Series 9 Episode 2
This episode of the AI in Education podcast features an interview with , the Director of Innovative Learning Technologies at in Sydney. Anthony, known for his impressive shirt collection and his kind-hearted approach to education, shares his insights on the challenges and opportunities presented by AI in assessment and personalisation of the learning experience for students. Anthony shares his vision for AI-driven personalised tutors, and how AI can assist in providing contextual and personalised feedback to students. We also cover the role of AI in helping teachers manage their workload and provide timely feedback. When we get onto the community of learning, we hear about Anthony's AI-driven agenda to better connect with parents, and bringing them into the community of learning - they become engaged rather than merely recipients of messages. Anthony talked about some of the events where he's a speaker, and the next ones to look out for him at are: EduTech Expo, in Melbourne on 14th August The AI in Education Conference, at Western Sydney University on 23rd August
/episode/index/show/aiineducationpodcast/id/32380522
info_outline
The Search for the Education Holy Grail in NSW - Series 9 Episode 1
07/25/2024
The Search for the Education Holy Grail in NSW - Series 9 Episode 1
In this episode Dan and Ray speak to Michelle Michael and Dan Hart from the New South Wales Department of Education about their world leading trial of AI, called NSWEduChat. Michelle is the NSW Department of Education Director: Education Support, Rural Initiatives and Gen AI. Her LinkedIn profile is . Dan is the Head of AI at the NSW DoE. His LinkedIn profile is Some of the resources that the team talked about in the episode are below: NSWEduChat landing page: NSW Department of Education: AI in Education - NSW Department of Education: Guidelines regarding the use of generative AI: : Manage personal information effectively and de-identify it to protect privacy. Techniques for de-identification: Use data anonymization and masking to remove or alter personal information. : Ensure accuracy and suitability of AI-generated content, aligning with ethical principles, teaching standards and quality teaching. : Attend training and professional learning on cybersecurity, data breach response, and child protection. : Create clear and specific prompts to improve the quality and relevance of AI-generated output. Future Frontiers - Education for an AI world: e-book: NSW DoE Future Frontiers landing page:
/episode/index/show/aiineducationpodcast/id/32271862
info_outline
From AI Detectors to Heartwarming Help: Two Tales of AI in a school
07/18/2024
From AI Detectors to Heartwarming Help: Two Tales of AI in a school
From AI Detectors to Heartwarming Help: Two Tales of AI in a school Series 8 Episode 11 In this episode of the AI in Education podcast, hosts Ray Fleming and Dan Bowen interview , a UK headteacher and lifelong friend of Dan. They talk about two contrasting stories from Martin's school—one highlighting the frustration in the application of AI when students were accused of cheating, and the other illustrating the compassionate use of AI to help a student undergoing cancer treatment participate in classes remotely via an AI-enabled robot. The discussion emphasises the complexities and ethical considerations of integrating AI in education. 00:00 Introduction 02:32 Martin's Background and School 03:50 AI in Education: Martin's Journey 05:59 Challenges with AI Detectors 09:23 Emotional Impact on Students 11:45 Reflections on AI in Assessment We discussed two assessment topics that have been in previous episodes: Sydney University's approach to assessment with Lane 1 and Lane 2 assessments - in The AI Assessment Scale research - in 22:34 Heartwarming Story: AI Robot for Student There's more reporting on this story on the 27:10 Conclusion and Final Thoughts
/episode/index/show/aiineducationpodcast/id/32207597
info_outline
The Turing Test - News and Research
07/11/2024
The Turing Test - News and Research
Another episode rounding up the latest news and research on AI in Education. The links below go straight to all the news stories and research papers discussed this week NEWS Victorian "Generative Artificial Intelligence Policy" for government schools. Meeting the AI Skills Boom LAUSD shelves its hyped AI chatbot to help students after collapse of firm that made it A class above: UNSW Sydney uses AI to power personalised paths to student success Research Detecting ChatGPT-Generated Essays in a Large-Scale Writing Assessment: Is There a Bias Against Non-Native English Speakers? GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Education Avoiding embarrassment online: Response to and inferences about chatbots when purchases activate self-presentation concerns Navigating the Ethical Landscape of Multimodal Learning Analytics: A Guiding Framework How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses AI Conversational Agent Design for Supporting Learning and Well-Being of University Students The Neglected 15%: Positive Effects of Hybrid Human-AI Tutoring Among Students with Disabilities The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performances The Future of Feedback: Integrating Peer and Generative AI Reviews to Support Student Work Is ChatGPT Transforming Academics' Writing Style? Can AI Provide Useful Holistic Essay Scoring? Read the excellent article about this paper in the Best Practices for Using AI When Writing Scientific Manuscripts A real-world test of artificial intelligence infiltration of a university examinations system: A “Turing Test” case study
/episode/index/show/aiineducationpodcast/id/32079367
info_outline
Dan Ingvarson - Unpacking AI's Role in Modern Education and Assessment
07/04/2024
Dan Ingvarson - Unpacking AI's Role in Modern Education and Assessment
Continuing our Series 8, focused on the topic of assessment, and the impact of AI, roving reporter Ray visits Fitzroy, Victoria, to interview , a notable founder and executive consultant in the field of AI in education, whilst co-host Dan (Welsh Dan?) joins remotely. Dan (Ingvarson) discusses his background and extensive work in AI policy and education technology, touching upon his involvement in various global initiatives including the Edsafe Alliance and Educational Services Australia. The conversation looks into the complexities of modern educational assessment, focusing on how generative AI can transform traditional assessment practices. He highlights the obstacles teachers face with current assessment methods and how AI could help alleviate some of these challenges by offering more personalised and authentic evaluations. The podcast also touches on the potential for AI to support teachers in creating effective rubrics and improving the overall quality of education through better data analytics. Ray and (Welsh) Dan emphasise the importance of evolving curricula to incorporate these advanced AI methodologies while discussing broader implications for student learning and teacher workload. 00:00 Introduction and Welcome 00:47 Meet Dan Ingvarsson: AI Guru 02:26 The Evolution of AI in Education 03:46 Deep Dive into Assessment 06:46 Challenges and Opportunities in AI-Assisted Assessment 19:21 Ensuring Authenticity in Student Work 23:28 Future of AI in Education 31:31 Practical Tips for Teachers 33:47 Conclusion and Final Thoughts
/episode/index/show/aiineducationpodcast/id/32009197
info_outline
Chicken Little's News and Research
06/27/2024
Chicken Little's News and Research
Content warning! This episode talks about an academic research paper titled "ChatGPT is bulls**t", and we've not edited the word out - in fact, we've gone to town with it, talking about the different types of it (in the strictest academic sense). So you may not want to play this in the car on your school run! The news item discussed is: Student crafts elaborate AI scheme to pass university exam, gets arrested This week's papers discussed are: Developing evaluative judgement for a time of generative artificial intelligence Prompting Large Language Models for Zero-shot Essay Scoring via Multi-trait Specialization Working Alongside, Not Against, AI Writing Tools in the Composition Classroom: a Dialectical Retrospective GPT versus Resident Physicians — A Benchmark Based on Official Board Scores Evaluating General Vision-Language Models for Clinical Medicine Re-evaluating GPT-4’s bar exam performance Automated Social Science: Language Models as Scientist and Subjects Large language models cannot replace human participants because they cannot portray identity groups I also mentioned the article about the the Infinite Focus Group, which is here: The impact of large language models on university students’ literacy development Do teachers spot AI? Evaluating the detectability of AI-generated texts among student essays Feedback sources in essay writing: peer-generated or AI-generated feedback? ChatGPT is bullshit
/episode/index/show/aiineducationpodcast/id/31896422
info_outline
Assessment with Leon Furze
06/20/2024
Assessment with Leon Furze
Wow, this week we have a bumper episode with more resources than a GPT factory! Any time we get a guest making their second appearance, and therefore enter our Hall of Fame, then we officially dub them "Friend of the Show". And so this week, we've got Friend of the Show Leon Furze sharing his experiences and expertise. Here are the links and posts related to our conversation with Leon around assessment. Leon's blog - for all the updates and posts that he is working on Leons's free e-Book on assessment can be found here: (free ebook on assessment) Leon Furze Linkedin profile is here if you want to follow his stream of thoughts, and to connect with him: The Artificial Intelligence Assessment Scale (AIAS) paper we discussed can be found here: The online course around practical AI strategies: And, even better, he's given listeners a discount code that will save you 25% of the cost. Just use the magic word 'AIPODCAST' The blog post we mentioned a couple of times during the episode: Leons new book and course can be also found on his main site here:
/episode/index/show/aiineducationpodcast/id/31816597
info_outline
Research Roundup - 14th June
06/13/2024
Research Roundup - 14th June
This week we set the episode timer for 15 minutes, and managed to get through just five papers before the buzzer went off! So we have plenty more papers to discuss in future episodes... ENHANCING K-12 STUDENTS’ PERFORMANCE IN CHEMISTRY THROUGH CHATGPT-POWERED BLENDED LEARNING IN THE EDUCATION 4.0 ERA Empowering student self-regulated learning and science education through ChatGPT: A pioneering pilot study ChatGPT “contamination”: estimating the prevalence of LLMs in the scholarly literature Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews Large language models are able to downplay their cognitive abilities to fit the persona they simulate
/episode/index/show/aiineducationpodcast/id/31724732
info_outline
Chris Goodall - Assessment, personalisation and chainsaws
06/05/2024
Chris Goodall - Assessment, personalisation and chainsaws
Assessment - Chris Goodall In this episode of the AI Education Podcast, host Dan converses with Chris Goodall, the head of digital education at the Bourne Education Trust in England. They discuss the integration of AI into education, how it can be used to enhance teaching and learning processes, and the impact of personalized AI tools on students and educators. The conversation covers practical applications of AI, the ongoing need for teacher and student adaptation to new technologies, as well as ethical considerations and future possibilities for AI in education. Chris Goodalls Linkedin profile here: Practical Advice for embedding IT in school:
/episode/index/show/aiineducationpodcast/id/31575212