loader from loading.io

A new picture of language

Many Minds

Release Date: 06/26/2024

Science, AI, and illusions of understanding show art Science, AI, and illusions of understanding

Many Minds

AI will fundamentally transform science. It will supercharge the research process, making it faster and more efficient and broader in scope. It will make scientists themselves vastly more productive, more objective, maybe more creative. It will make many human participants—and probably some human scientists—obsolete… Or at least these are some of the claims we are hearing these days. There is no question that various AI tools could radically reshape how science is done, and how much science is done. What we stand to gain in all this is pretty clear. What we stand to lose is less obvious,...

info_outline
The primeval soil of play show art The primeval soil of play

Many Minds

Puppies wrestling and mock-biting each other. Toddlers playing hide and seek. Kittens pouncing—repeatedly—on a toy mouse. You've no doubt looked on at scenes like this with amusement. And you've no doubt seen some of those viral videos—of ravens sledding down hills, of bumble bees playing with balls. All these moments make us smile, maybe even giggle. But the scientific questions they raise merit serious attention. Where do we see play in the animal kingdom? Where do we not? What functions does play serve? Do we—and many other creatures—have an elemental need for play? My guest today...

info_outline
The big five and beyond show art The big five and beyond

Many Minds

If you've heard anything about the study of human personality, you've probably heard about the “big five.” This is a framework that attempts to characterize human personality in terms of five broad factors or dimensions—neuroticism, extraversion, openness, conscientiousness, and agreeableness. The big five framework has been enormously influential, generating heaps and heaps of data, and study after study on the stability of personality, on the factors that shape our personalities, on how our personalities predict success and satisfaction. But is the big five really the best we can do?...

info_outline
Philosophers on psychedelics show art Philosophers on psychedelics

Many Minds

Some call it the "psychedelic renaissance." In the last decade or so, interest in psychedelic drugs has surged—and not just among Silicon Valley types and psychiatrists and neuroscientists. It's also surged among a stereotypically soberer crowd: academic philosophers. The reasons are clear. With their varied and sometimes transformative effects, psychedelics raise ethical questions, epistemological questions, metaphysical questions, questions about the nature of experience and the nature of the mind. My guest today is . Chris is a philosopher of cognitive science at the University of Western...

info_outline
The cuttlefish and its coat of many colors show art The cuttlefish and its coat of many colors

Many Minds

We humans have a hard time becoming invisible. For better or worse, we're basically stuck with the skin and body we have; we’re pretty fixed in our color, our shape, our overall appearance. And so we're fascinated by creatures that aren't—creatures that morph to meet the moment, that can functionally disappear, that can shape-shift on a dime. And no creatures are more skilled, more astonishing, more bedazzling in their abilities to do this kind of thing than the cephalopods. But how do they do this exactly? What's going on in their skin? What's going on under their skin? And what's going...

info_outline
Life, free energy, and the pursuit of goals show art Life, free energy, and the pursuit of goals

Many Minds

You've probably come across the "free energy principle." It's become one of the most influential ideas in the broader cognitive sciences. Since the neuroscientist Karl Friston first introduced it in 2005, the theory has been fleshed out, extended, generalized, criticized, and cited thousands and thousands of times. But what is this idea, exactly? What does it say about the nature of brains and minds? What does it say about the phenomenon of life itself? And is anything that it says really that new? My guest today is . Kate is a philosopher at the University of Edinburgh and the author of the...

info_outline
Universal emotions in fact and fiction show art Universal emotions in fact and fiction

Many Minds

Are human emotions universal? Or do they vary from one place to the next and from one time period to the next? It's a big question, an old question. And every discipline that's grappled with it brings its own take, its own framings and forms of evidence. Some researchers appeal to cross-cultural experiments; others turn to neuroimaging studies or conceptual analysis. Some even look to fiction. My guest today is , an Associate Professor of English Literature at Arizona State University. Brad is the author of a new book, ; in it he maps the landscape of debate around this long-contested topic....

info_outline
From the archive: Fermentation, fire, and our big brains show art From the archive: Fermentation, fire, and our big brains

Many Minds

Hi friends, We're taking care of some spring cleaning this week. We'll be back in two weeks with a new episode. In the meantime, enjoy this favorite from our archives! - The Many Minds team ––––––––– [originally aired February 22, 2024] Brains are not cheap. It takes a lot of calories to run a brain, and the bigger your brain, the more calories it takes. So how is it that, over the last couple million years, the human brain tripled in size. How could we possibly have afforded that? Where did the extra calories come from? There's no shortage of suggestions out there. Some say...

info_outline
Howl, grunt, sing show art Howl, grunt, sing

Many Minds

The tree of life is a noisy place. From one branch come hoots and howls, from another come clicks and buzzes and whines. And coming from all over you hear the swell of song. But what is all this ruckus about? Why do so many animals communicate with sound? What kinds of meaning do these sounds convey? And—beyond the case of human speech—do any of these sounds merit the label of “language”? My guest today is , a zoologist at Cambridge University. Arik is an expert on vocal communication across the animal kingdom and the author of the recent book . Here, Arik and I talk about why the...

info_outline
The development of evolution show art The development of evolution

Many Minds

Evolution is not what it used to be. A lot has changed since Darwin's day. In the first half of the 20th century, evolutionary theory was integrated with an emerging understanding of genetics. Late in the 20th century, biologists started taking seriously the idea that organisms don't just adapt to their environments, they change them. Recently, researchers have started to acknowledge the role of culture in evolutionary processes. And so slowly our understanding of evolution has been reconsidered, updated, expanded. And more updates are underway. But it's not just our understanding of evolution...

info_outline
 
More Episodes

 If you've taken Linguistics 101, you know what language is. It's a system for conveying meaning through speech. We build words out of sounds, and then complex ideas out of those words. Remarkably, the relationship between the sounds and the meanings they convey is purely arbitrary. Human language consists, in other words, of abstract symbols. Now, of course, there are also sign languages, but these operate in the same way, just in a different medium. This, anyway, is the view of language that has dominated and defined linguistics for many decades. But some think it gets some pretty fundamental things pretty wrong. Some think we need a new picture of language altogether. 

My guest today is Dr. Neil Cohn. Neil is Associate Professor at the Tilburg Center for Cognition and Communication, in the Netherlands; he is also the director of the Visual Language Lab at Tilburg. For about two decades, Neil has been studying the rich properties of graphic systems—especially comics—and has built an argument that some constitute full-blown languages. His latest book, co-authored with, Joost Schilperoord, is titled A Multimodal Language Faculty. It challenges that longstanding, deeply held view of what language is. Instead, the book argues that the human language capacity combines three different modalities—the vocal modality (as in speech), the bodily modality (as in gesture), and the graphic modality (as in comics and other visual narratives). And each of these modalities is naturally able to support full-blown languages.

Here, Neil and I talk about the basic assumptions of modern linguistics and where those assumptions come from. We discuss the idea that there are three expressive modalities that come naturally to humans, with each modality optimized for certain kinds of meaning. We talk about Neil's career, not only as an academic, but as an illustrator. We discuss cross-cultural differences and similarities in comics, and how comics have changed over the last century. And, finally, we consider how Neil's framework challenges current theorizing about the evolution of language. Along the way, Neil and I touch on sign languages and homesign systems, visual style vs visual language, Peircean semiotics, animal tracks, cave art, emoji, upfixes, sand drawing, Manga, the refrain "I can't draw," and the idea that the graphic modality is the only one that's truly unique to our species. 

After this episode we'll be taking a bit of a summer break, but we'll be posting some old favorites to tide you over. Alright friends, hope you enjoy this one. On to my conversation with Neil Cohn. Enjoy!

 

 A transcript of this episode is available here

 

Notes and links

3:30 – An earlier paper by Dr. Cohn on the well-worn refrain “I can’t draw.” His more recent Twitter thread covering the topic. 

9:00 – An overview of research on homesign systems. For a broader discussion of differences between gesture, homesign systems, and established sign languages, see here

15:00 – A comic, ‘Chinese Room,’ commissioned by the philosopher Dan Dennett and drawn by Dr. Cohn.

19:30 – The webpage of Dr. Cohn’s graduate mentor, Ray Jackendoff.

25:00 – A brief overview paper by Dr. Cohn and Dr. Schilperoord on the need to “reimagine language.”

25:30 – The classic book, based on lecture notes, by Ferdinand de Saussure, ‘Course in General Linguistics.' 

44:00 – For an overview of “bimodal bilingualism,” see here. 

50:00 – A study by Dr. Cohn and colleagues on the processing of emoji substituted for words.

56:00 – A recent study by Dr. Cohn and colleagues on anaphora in visual narratives. 

58:30 – For our previous audio essay on animal (and human) tracks, see here

1:01:30 – For examples of scholarship on non-Western methods of visual storytelling, including Aboriginal Australian sand drawing, see Dr. Cohn’s earlier edited volume here. For a deeper dive into sand drawing, see the monograph by Jenny Green here. 

1:03:00 – Dr. Cohn also recently published a book on cross-cultural aspects of comics, The Patterns of Comics. The book is the fruit of his lab’s TINTIN project

1:11:00 – For a video of Aboriginal Australian sand drawing, see here.

1:13:00 – See Dr. Cohn’s earlier book, Who Understands Comics?

1:15:00 – A study on “upfixes” by Dr. Cohn and a colleague.

1:22:00 – A popular article by Dr. Cohn on the linguistic status of emoji.

1:31:00 – For a deep dive into Peircean semiotics, see here.

1:36:00 – For my own general-audience treatment of “gesture first” theories of language evolution and the “modality transition” problem, see here.

1:37:00 – A paper by Dr. Jackendoff and Eva Wittenberg outlining their “complexity hierarchy.” 

­­­­1:50:00 – For the Getty museum exhibit associated with Dr. Cohn’s lecture, see here.

 

Recommendations

The Texture of the Lexicon, by Jenny Audring and Ray Jackendoff

Battle in the Mind Fields, by John Goldsmith and Bernard Laks

History and Philosophy of the Language Sciences podcast, hosted by James McElvenny

 

Many Minds is a project of the Diverse Intelligences Summer Institute, which is made possible by a generous grant from the Templeton World Charity Foundation to UCLA. It is hosted and produced by Kensy Cooperrider, with help from Assistant Producer Urte Laukaityte and with creative support from DISI Directors Erica Cartmill and Jacob Foster. Our artwork is by Ben Oldroyd. Our transcripts are created by Sarah Dopierala. 

Subscribe to Many Minds on Apple, Stitcher, Spotify, Pocket Casts, Google Play, or wherever you listen to podcasts. You can also now subscribe to the Many Minds newsletter here!

We welcome your comments, questions, and suggestions. Feel free to email us at: [email protected]

For updates about the show, visit our website or follow us on Twitter: @ManyMindsPod.