loader from loading.io

From the archive: Aligning AI with our values

Many Minds

Release Date: 10/18/2023

What is memory for? show art What is memory for?

Many Minds

Everyone loves a good evolutionary puzzle. Why do we have appendices? Why do we dream? Why do we blush? At first glance, memory would not seem to be in this category. It's clearly useful to remember stuff, after all—to know where to find food, to remember your mistakes so you don't repeat them, to recall who’s friendly and who’s fierce. In fact, though, certain aspects of memory—when you hold them up to the light—turn out to be quite puzzling indeed. My guests today are and . Ali is a philosopher at the London School of Economics (LSE); Johannes is a philosopher at York University,...

info_outline
Of breeds and brains show art Of breeds and brains

Many Minds

It's hard to say exactly when, but some tens of thousands of years ago, our best friends were born. I'm referring, of course, to dogs. This didn't happen overnight—it was a long process. And it not only changed how those canids behaved and what they looked like, it also changed their brains. As wolves gave way to proto-dogs, and proto-dogs gave way to dingoes and dalmatians and Dobermanns and all the rest, their brains have continued to change. What can we learn from this singular saga? What does it tell us about dogs, about domestication, and about brains?  My guest today is . Erin is...

info_outline
Monsters and their makers show art Monsters and their makers

Many Minds

It seems we've always had monsters among us. We've long been enthralled by dragons and giants, by the likes of Frankenstein and Godzilla and Dracula, by witches and werewolves and countless others. They roam our maps and creation myths; they crop up in our dreams, in our children's books, in our political rhetoric. Where do these beings spring from? What do they do for us? How have they changed over time? And, ultimately, what do our monsters say about their makers? My guests today are and . Both are historians of science and authors of recent books on monsters: Natalie's book is . Surekha's...

info_outline
The age of social AI show art The age of social AI

Many Minds

AI therapists and caregivers. Digital tutors and advisors and friends. Artificial lovers. Griefbots trained to imitate dead loved ones. Welcome, to the bustling world of AI-powered chatbots. This was once the stuff of science fiction, but it's becoming just the stuff of everyday life. What will these systems do to our society, to our relationships, to our social skills and motivations? Are these bots destined to leave us hollowed out, socially stunted, screen-addicted, and wary of good-old-fashioned, in-the-flesh human interaction? Or could they actually be harnessed for good? My guest today...

info_outline
Brains of a feather show art Brains of a feather

Many Minds

Birds do the darnedest things. They fly, of course. They sing. They hunt in pitch darkness. They hide their food and remember where they put it. They use tools and migrate over astonishingly vast distances—sometimes even sleeping while in flight. How do they do all this? What's going on in their brains that makes these and other remarkable behaviors possible? How did their evolutionary path mold them into the incredible creatures they are today? My guests today are and . Andrew is a comparative neuroscientist and Associate Professor at the University of Lethbridge in Canada. Georg is a...

info_outline
How nature restores the mind show art How nature restores the mind

Many Minds

One afternoon you decide to snub your responsibilities and go for a hike. You spend a few hours in the woods or the mountains. You study the bark of trees, you bathe in birdsong, you let your eyes roam along a distant ridgeline. And you come back feeling better, restored somehow—like you have more energy, more patience, more bandwidth. We've all, I'm guessing, had experiences like this. But what's behind these effects? Why would nature restore us? What's the evidence that it really does? And what is even being restored, actually? My guest today is . Marc is an Associate Professor in the...

info_outline
From the archive: Revisiting the dawn of human cognition show art From the archive: Revisiting the dawn of human cognition

Many Minds

Hi friends! We're taking a much-needed summer pause—we'll have new episodes for you later in September. In the meanwhile, enjoy this pick from our archives! ------- [originally aired June 1, 2023] There's a common story about the human past that goes something like this. For a few hundred thousand years during the Stone Age we were kind of limping along as a species, in a bit of a cognitive rut, let’s say. But then, quite suddenly, around 30 or 40 thousand years ago in Europe, we really started to come into our own. All of a sudden we became masters of art and ornament, of symbolism and...

info_outline
From the archive: Of molecules and memories show art From the archive: Of molecules and memories

Many Minds

Hi friends! We're taking a much-needed August pause—we'll have new episodes for you in September. In the meanwhile, enjoy this pick from our archives! _____ [originally aired February 8, 2024] Where do memories live in the brain? If you've ever taken a neuroscience class, you probably learned that they're stored in our synapses, in the connections between our neurons. The basic idea is that, whenever we have an experience, the neurons involved fire together in time, and the synaptic connections between them get stronger. In this way, our memories for those experiences become minutely etched...

info_outline
From the archive: Consider the spider show art From the archive: Consider the spider

Many Minds

Hi friends! We're taking a much-needed August pause—we'll have new episodes for you in September. In the meanwhile, enjoy this pick from our archives! _____ [originally aired May 30, 2024] Maybe your idea of spiders is a bit like mine was. You probably know that they have eight legs, that some are hairy. Perhaps you imagine them spending most of their time sitting in their webs—those classic-looking ones, of course—waiting for snacks to arrive. Maybe you consider them vaguely menacing, or even dangerous. Now this is not all completely inaccurate—spiders do have eight legs, after...

info_outline
The shaman with a thousand faces show art The shaman with a thousand faces

Many Minds

When you hear the word "shaman," I'm guessing a web of associations starts to form in your mind. Perhaps you imagine strange ceremonies and strong substances; maybe you think of an earlier time when magic and superstition reigned. But shamanism is not just some relic of the past, or a curio from exotic lands. It's part of our present, and it will almost certainly be part of our future. This is because the roots of shamanism lie within us all. My guest today is . Manvir is an Assistant Professor of Anthropology at the University of California, Davis and to The New Yorker. He's also the author...

info_outline
 
More Episodes

Hi friends, we're on hiatus for the fall. To tide you over, we’re putting up some favorite episodes from our archives. Enjoy!

----

[originally aired February 17, 2021]

Guess what folks: we are celebrating a birthday this week. That’s right, Many Minds has reached the ripe age of one year old. Not sure how old that is in podcast years, exactly, but it’s definitely a landmark that we’re proud of. Please no gifts, but, as always, you’re encouraged to share the show with a friend, write a review, or give us a shout out on social.

To help mark this milestone we’ve got a great episode for you. My guest is the writer, Brian Christian. Brian is a visiting scholar at the University of California Berkeley and the author of three widely acclaimed books: The Most Human Human, published in 2011; Algorithms To Live By, co-authored with Tom Griffiths and published in 2016; and most recently, The Alignment Problem. It was published this past fall and it’s the focus of our conversation in this episode.

The alignment problem, put simply, is the problem of building artificial intelligences—machine learning systems, for instance—that do what we want them to do, that both reflect and further our values. This is harder to do than you might think, and it’s more important than ever.

As Brian and I discuss, machine learning is becoming increasingly pervasive in everyday life—though it’s sometimes invisible. It’s working in the background every time we snap a photo or hop on Facebook. Companies are using it to sift resumes; courts are using it to make parole decisions. We are already trusting these systems with a bunch of important tasks, in other words. And as we rely on them in more and more domains, the alignment problem will only become that much more pressing.

In the course of laying out this problem, Brian’s book also offers a captivating history of machine learning and AI. Since their very beginnings, these fields have been formed through interaction with philosophy, psychology, mathematics, and neuroscience. Brian traces these interactions in fascinating detail—and brings them right up to the present moment. As he describes, machine learning today is not only informed by the latest advances in the cognitive sciences, it’s also propelling those advances.

This is a wide-ranging and illuminating conversation folks. And, if I may say so, it’s also an important one. Brian makes a compelling case, I think, that the alignment problem is one of the defining issues of our age. And he writes about it—and talks about it here—with such clarity and insight. I hope you enjoy this one. And, if you do, be sure to check out Brian’s book.

Happy birthday to us—and on to my conversation with Brian Christian. Enjoy!

 

A transcript of this show is available here.

 

Notes and links

7:26 - Norbert Wiener’s article from 1960, ‘Some moral and technical consequences of automation’.

8:35 - ‘The Sorcerer’s Apprentice’ is an episode from the animated film, Fantasia (1940). Before that, it was a poem by Goethe.

13:00 - A well-known incident in which Google’s nascent auto-tagging function went terribly awry.

13:30 - The ‘Labeled Faces in the Wild’ database can be viewed here.

18:35 - A groundbreaking article in ProPublica on the biases inherent in the Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) tool.

25:00 – The website of the Future of Humanity Institute, mentioned in several places, is here.

25:55 - For an account of the collaboration between Walter Pitts and Warren McCulloch, see here.

29:35- An article about the racial biases built into photographic film technology in the 20th century.

31:45 - The much-investigated Tempe crash involving a driverless car and a pedestrian:

37:17 - The psychologist Edward Thorndike developed the “law of effect.” Here is one of his papers on the law.

44:40 - A highly influential 2015 paper in Nature in which a deep-Q network was able to surpass human performance on a number of classic Atari games, and yet not score a single point on ‘Montezuma’s Revenge.’

47:38 - A chapter on the classic “preferential looking” paradigm in developmental psychology:

53:40 - A blog post discussing the relationship between dopamine in the brain and temporal difference learning. Here is the paper in Science in which this relationship was first articulated.

1:00:00 - A paper on the concept of “coherent extrapolated volition.”

1:01:40 - An article on the notion of “iterated distillation and amplification.”

1:10:15 - The fourth edition of a seminal textbook by Stuart Russell and Peter Norvig, AI a Modern approach, is available here: http://aima.cs.berkeley.edu/

1:13:00 - An article on Warren McCulloch’s poetry.

1:17:45 - The concept of “reductions” is central in computer science and mathematics.

 

Brian Christian’s end-of-show reading recommendations:

The Alignment Newsletter, written by Rohin Shah

Invisible Women, by Caroline Criado Perez:

The Gardener and the Carpenter, Alison Gopnik:

You can keep up with Brian at his personal website or on Twitter.

 

Many Minds is a project of the Diverse Intelligences Summer Institute, which is made possible by a generous grant from the Templeton World Charity Foundation to UCLA. It is hosted and produced by Kensy Cooperrider, with help from Assistant Producer Urte Laukaityte and with creative support from DISI Directors Erica Cartmill and Jacob Foster. Our artwork is by Ben Oldroyd. Our transcripts are created by Sarah Dopierala.

Subscribe to Many Minds on Apple, Stitcher, Spotify, Pocket Casts, Google Play, or wherever you listen to podcasts. You can also now subscribe to the Many Minds newsletter here!

We welcome your comments, questions, and suggestions. Feel free to email us at: manymindspodcast@gmail.com. 

For updates about the show, visit our website or follow us on Twitter: @ManyMindsPod.