Building at the intersection of machine learning and software engineering
Thoughtworks Technology Podcast
Release Date: 05/02/2024
Exploring the intersections of software architecture
Thoughtworks Technology Podcast
Software architecture necessarily intersects with a diverse range of critical things, including implementation, infrastructure, data and engineering practices. All these elements require serious consideration and reflection if you're to architect effectively. To discuss these various intersections, Thoughtworks' Neal Ford and his long-time collaborator Mark Richards join host Prem Chandrasekaran on the Thoughtworks Technology Podcast. They dive into why these intersections matter, what they mean for software architects and how individuals and teams can go about addressing them.
info_outline
Who should make software architecture decisions?
Thoughtworks Technology Podcast
Who should be involved in the process of making decisions about software architecture? That's a question that's been puzzling Thoughtworker Andrew Harmel-Law for some time — so much so that he decided to write a book about it. The result is Facilitating Software Architecture. Published by O'Reilly in December 2024, it's both an argument for and a guide to involving more people in the architecture decision process. To discuss the topic and the book, Andrew joined hosts Neal Ford and Prem Chandrasekaran on the Technology Podcast. They explore why including more roles in software architecture...
info_outline
Generative AI's uncanny valley: Problem or opportunity?
Thoughtworks Technology Podcast
With the rise of generative AI, the concept of the uncanny valley — where human resemblance unsettles, disturbs or disgusts — is more relevant than ever. But is it a problem that technologists need to tackle? Or does it offer an opportunity for greater thoughtfulness about the ways generative AI is being built, deployed and used? In this episode of the Technology Podcast, host Lilly Ryan is joined by Srinivasan Raguraman to discuss generative AI's uncanny valley and explore how it might offer a model for thinking through our expectations about generative AI outputs and effects. Taking in...
info_outline
Using generative AI for legacy modernization
Thoughtworks Technology Podcast
Legacy modernization is an enduring challenge — and as systems become more complex, the difficulty of understanding and modelling a system so it can be modernized only becomes more difficult. However, at Thoughtworks we've seen some recent success bringing generative AI into the legacy modernization process. To discuss what this means in practice and the benefits it can deliver, host Ken Mugrage is joined by Thoughtworks colleagues Shodhan Sheth and Tom Coggrave. Shodhan and Tom have been working together in this space in recent months and, in this episode of the Technology Podcast, offer...
info_outline
Data contracts: What are they and why do they matter?
Thoughtworks Technology Podcast
Data contracts are a bit like APIs for data — they make it possible to interface with data in a way that ensures the transfer of data from one place to another is stable and reliable. This is particularly important for building more reliable data-driven applications. To discuss data contracts, host Lilly Ryan is joined on the Technology Podcast by Andrew Jones, the creator of the data contract concept (in 2021) and author of Driving Data Quality with Data Contracts (2023), and Thoughtworker Ryan Collingwood who is currently writing their own book on data contracts due to be published in...
info_outline
In conversation with Thomas Squeo, Thoughtworks CTO for the Americas
Thoughtworks Technology Podcast
What does it mean to be a technology leader today? What kind of challenges must you address? What questions do you need to answer? To explore all that — and dive into what it looks like from a Thoughtworks perspective — host Ken Mugrage spoke to Thomas Squeo, the CTO for Thoughtworks in the Americas. They discuss everything from keeping track of emerging technologies and wider industry shifts, to product thinking, AI and career development. Listen to get to know a Thoughtworks leader and discover fresh perspectives on some of the big questions and debates all of us in tech keep finding...
info_outline
Themes from Technology Radar Vol.31
Thoughtworks Technology Podcast
Volume 31 of the Technology Radar will be released on October 23, 2024. As always, it will feature 100+ technologies and techniques that we've been using with clients around the world. Alongside them will be a set of key themes that emerged during the process of putting it together. We think they offer another way into the Radar and give a unique insight on some of the most interesting issues impacting the software industry. In this episode of the Technology Podcast we discuss them: coding assistance antipatterns, Rust being anything but rusty, the rise of WebAssembly and what we describe as...
info_outline
Build Your Own Radar: Using the Technology Radar as a governance tool
Thoughtworks Technology Podcast
The Thoughtworks Technology Radar is, first and foremost, a publication. It's a document that anyone in the tech industry can read twice a year to learn about our experiences and perspectives on technology. However, it's also more than that: it's built on top of a process of deliberation, discussion and curation. We think that's particularly important — it's something we encourage technology teams and organizations to do and which we support with our Build Your Own Radar tool. On this episode of the Technology Podcast, Neal Ford and Ken Mugrage join Prem Chandrasekaran to discuss...
info_outline
Exploring DuckDB: A relational database built for online analytical processing
Thoughtworks Technology Podcast
There are no shortage of options when it comes to relational databases. While the likes of PostgreSQL have proven enduring, even as the market has evolved, for data scientists and data engineers that need to manage and query particularly complex or large data sets, the most popular databases aren't always right for the job. Thankfully, this is where projects like DuckDB can help. Built for what's called 'vectorized query execution', it's well-suited to the demands of online analytical processing (OLAP). To get a deeper understanding of DuckDB and how the product has developed, on this episode...
info_outline
Software service granularity: Getting it right
Thoughtworks Technology Podcast
It's widely accepted that, in most cases at least, software systems should be modular, consisting of separate, discrete services. But what about the size of those services? How big or small should they be? This is where the question of service granularity comes in: too small and your system will become needlessly complicated; too big and you lose all the benefits of modularity you were seeking in the first place. In this episode of the Thoughtworks Technology Podcast, host Ken Mugrage is joined by Neal Ford and Mark Richards — authors of multiple books on software architecture — to discuss...
info_outlineBringing machine learning models into production is challenging. This is why, as demand for machine learning capabilities in products and services increases, new kinds of teams and new ways of working are emerging to bridge the gap between data science and software engineering. Effective Machine Learning Teams — written by Thoughtworkers David Tan, Ada Leung and Dave Colls — was created to help practitioners get to grips with these challenges and master everything needed to deliver exceptional machine learning-backed products.
In this episode of the Technology Podcast, the authors join Scott Shaw and Ken Mugrage to discuss their book. They explain how it addresses current issues in the field, taking in everything from the technical challenges of testing and deployment to the cultural work of building teams that span different disciplines and areas of expertise.
Learn more about Effective Machine Learning Teams: https://www.thoughtworks.com/insights/books/effective-machine-learning-teams
Read a Q&A with the authors: https://www.thoughtworks.com/insights/blog/machine-learning-and-ai/author-q-and-a-effective-machine-learning-teams