When a human learns a new word, we're learning to attach that word to a set of concepts in the real world. When a computer "learns" a new word, it is creating some associations between that word and other words it has seen before, which can sometimes give it the appearance of understanding, but it doesn't have that real-world grounding, which can sometimes lead to spectacular failures: hilariously implausible from a human perspective, just as plausible from the computer's. 

In this episode, your host Lauren Gawne gets enthusiastic about how computers process language with Dr. Emily M. Bender, who is a linguistics professor at the University of Washington, USA, and cohost of the podcast Mystery AI Hype Theater 3000. We talk about Emily's work trying to formulate a list of rules that a computer can use to generate grammatical sentences in a language, the differences between that and training a computer to generate sentences using the statistical likelihood of what comes next based on all the other sentences, and the further differences between both those things and how humans map language onto the real world.  We also talk about paying attention to communities not just data, the labour practices behind large language models, and how Emily's persistent questions led to the creation of the Bender Rule (always state the language you're working on, even if it's English).

Click here for a link to this episode in your podcast player of choice: episodes.fm/1186056137/episode/dGFnOnNvdW5kY2xvdWQsMjAxMDp0cmFja3MvMTk2NDIxOTY5OQ

 Read the transcript here: lingthusiasm.com/post/767803835730231296/transcript-episode-98

Announcements:
The 2024 Lingthusiasm Listener Survey is here! It’s a mix of questions about who you are as our listener, as well as some fun linguistics experiments for you to participate in. If you have taken the survey in previous years, there are new questions, so you can participate again this year. Take the survey here: bit.ly/lingthusiasmsurvey24

In this month’s bonus episode we get enthusiastic about three places where we can learn things about linguistics!! We talk about two linguistically interesting museums that Gretchen recently visited: the Estonian National Museum, as well as Mundolingua, a general linguistics museum in Paris. We also talk about Lauren's dream linguistics travel destination: Martha's Vineyard. 

Join us on Patreon now to get access to this and 90+ other bonus episodes. You’ll also get access to the Lingthusiasm Discord server where you can chat with other language nerds. Sign up here: patreon.com/posts/115117867

Also, Patreon now has gift memberships! If you'd like to get a gift subscription to Lingthusiasm bonus episodes for someone you know, or if you want to suggest them as a gift for yourself, here's how to gift a membership: patreon.com/lingthusiasm/gift

For links to things mentioned in this episode: lingthusiasm.com/post/767803572750581760/lingthusiasm-episode-98-helping-computers-decode

98: Helping computers decode sentences - Interview with Emily M. Bender

Are emoji words? Should "Pokémon," "genderqueer," or "Brexit" be added to the dictionary? What word best sums up 2016? Lexicography is a venerable profession that's changed a lot with new technology: now we can crowdfund a million new free-range definitions, find the exact person who first tweeted a new word and see in real time which words people are looking up and why. Join this panel of linguistic decision-makers for a behind-the-scenes look into how a new word makes it into the dictionary, where Words of the Year come from, how dictionaries use social media to engage the public and more.

This panel was presented at South by Southwest Interactive 2017. 
Moderator: Gretchen McCulloch. 
Panelists: Erin McKean, Jane Solomon, Ben Zimmer.

Word Curation: Dictionaries, Tech and the Future at SXSW 2017

There are some pretty funny quotes of historical people complaining about kids back then doing linguistic things that now seem totally unremarkable. So let’s cut to the chase and celebrate linguistic innovation while it’s happening. 

In episode 7 of Lingthusiasm, your hosts Lauren Gawne and Gretchen McCulloch explore how far back we can trace complaints about the language of Kids These Days, why linguistic discrimination is harmful, and why “be like”, hyperbolic “literally”, and other modern innovations are actually signs of something awesome. 

We also announce a Patreon to keep the podcast sustainable! You can support us there to listen to a bonus episode about swearing and future monthly bonus content, and help decide the topics of future episodes. Even if you’re not sure about pledging, do check out the Patreon goals to see some of our future plans and our video to see a totally realistic and not at all staged cameo from our producer. Check out http://patreon.com/lingthusiasm 

For more information visit the show page: http://lingthusiasm.com/post/159796192161/lingthusiasm-episode-7-kids-these-days-arent

07: Kids these days aren’t ruining language

Dictionaries: they’re made by real people! 

In episode 8 of Lingthusiasm, your hosts Lauren Gawne and Gretchen McCulloch talk about Word by Word, a recent book by Kory Stamper, a lexicographer at Merriam-Webster, about how dictionaries get made. (Spoiler: we liked it.) We also talk about how dictionaries get made for languages that don’t have any yet, the changing role of dictionaries on the internet and with social media, and how words often have a longer history than we expect (’g-string’, for example has been in use since at least 1878). 

Our latest Patreon bonus is about selling your linguistics skills to employers. (Previous bonuses: swearing and how to teach yourself linguistics.) Go to http://patreon.com/lingthusiasm to check them out!

For more information, and links to things mentioned in this episode, visit the show page: http://lingthusiasm.com/post/160811944696/lingthusiasm-episode-8-people-who-make

08: People who make dictionaries

How do we get from knowing words to making brand-new sentences out of them? In episode 9 of Lingthusiasm, your hosts Gretchen McCulloch and Lauren Gawne talk about how words form groups with other words: constituency. 

Once you start looking for it, constituency is everywhere: in ambiguous sentences like “time flies like an arrow; fruit flies like a banana”, in remixed films like “Of Oz The Wizard”, and even internet dog memes.

This month’s Patreon bonus was the backstory about the linguistics of the doggo meme and its connection to Australian slang, which grew out of this NPR article about doggo. You can get access to it and previous bonuses about swearing, teaching yourself linguistics, and explaining linguistics to employers by supporting Lingthusiasm on Patreon.

For more information, and links to things mentioned in this episode, visit the show page: http://lingthusiasm.com/post/161859273886/lingthusiasm-episode-9-the-bridge-between-words

09: The bridge between words and sentences - Constituency

Some linguists work with multiple languages, while others focus on just one. But for many people, learning a language after early childhood is the thing that first gets them curious about how language works in general and all the things in their native language(s) that they take for granted. 

In episode 10 of Lingthusiasm, your hosts Gretchen McCulloch and Lauren Gawne talk about how learning languages can feed into linguistics and vice versa. We also explore the power dynamics that affect learning languages, and the importance of learning about the rules of interaction as well as the rules of grammar.

This month’s Patreon bonus was about hypercorrection, where you try so hard to follow a linguistic rule that you end up overshooting. You can get access to it and previous bonuses about the doggo meme, swearing, teaching yourself linguistics, and explaining linguistics to employers by supporting Lingthusiasm on Patreon. http://patreon.com/lingthusiasm

Gretchen’s new recorder in this episode is thanks to the support of our patrons! 

For more information, and links to things mentioned in this episode, visit the show page: http://lingthusiasm.com/post/163226798571/lingthusiasm-episode-10-learning-languages

10: Learning languages linguistically

– Would you like some coffee? 
– Coffee would keep me awake. 

Does that mean yes coffee, or no coffee? It depends! Is it the morning or the evening? Is the person trying to pull an all-nighter or take an afternoon nap? A computer looking strictly at the meanings of the words would be confused, but we humans do this kind of thing all the time without even noticing it. 

In episode 11 of Lingthusiasm, your hosts Gretchen McCulloch and Lauren Gawne talk about the hidden assumptions of cooperation that we bring to every conversation. They were formulated by the linguist Paul Grice, and are known as the Cooperative Principle or Grice’s Maxims. Not only does stating these assumptions explicitly help us understand conversations where we exchange messages beyond the literal meaning of our words, but it also explains a lot of humour – many jokes rely on creative flouting of Gricean Maxims! 

This month’s Patreon bonus was about language play: games like Pig Latin, rhyming slang, and Verlan, as nominated and voted on by our patrons. You can get access to it and previous bonuses about hypercorrection, the doggo meme, swearing, teaching yourself linguistics, and explaining linguistics to employers by supporting Lingthusiasm on Patreon. http://patreon.com/lingthusiasm

We hit our next funding goal shortly after recording this episode, which will allow us to start bringing on guest linguists, so stay tuned for more info on upcoming interviews!  

For the links mentioned in this episode, check out our shownotes page at: http://lingthusiasm.com/post/164303700686/lingthusiasm-episode-11-layers-of-meaning

11: Layers of meaning - Cooperation, humour, and Gricean Maxims

Why does it always sound slightly off when someone tries to imitate your accent? Why do tiny children learning your second language already sound better than you, even though you’ve been learning it longer than they’ve been alive? What does it mean for there to be sounds you can’t hear?

In Episode 12 of Lingthusiasm, your hosts Lauren Gawne and Gretchen McCulloch explore the fundamental linguistic insight at the heart of all these questions: the phoneme. We also talk about how to bore babies (for science!), how sounds appear and disappear in a language, and how to retain our sense of wonder when the /t/ you hear doesn’t match up with the /t/ I hear. 

LIVESHOW: Exciting news! We held our first liveshow on Saturday, September 23rd in Montreal, at Argo Bookshop. It was great to meet so many lingthusiasts at this sold out show. We’re looking forward to bringing the liveshow experience to more people, once we hit our Patreon goal.

This month’s Patreon bonus was about linguistic research, and how to become the go-to person among your friends for linguistics questions when you don’t have a university or a research budget, as nominated and voted on by our patrons. You can get access to it and previous bonuses about language games, hypercorrection, swearing, teaching yourself linguistics, and explaining linguistics to employers by supporting Lingthusiasm on Patreon. http://patreon.com/lingthusiasm

For the links mentioned in this episode, check out our shownotes page at: http://lingthusiasm.com/post/165591628291/lingthusiasm-episode-12-sounds-you-cant-hear

12: Sounds you can’t hear - Babies, accents, and phonemes

If you grow up with multiple accents to choose from, what does the one you choose say about your identity? How can linguistics unpick our hidden assumptions about what “sounds angry” or “sounds articulate”? What can we learn from studying the melodies of speech, in addition to the words and sounds? 

In Episode 13 of Lingthusiasm, your host Gretchen McCulloch interviews Dr. Nicole Holliday, an Associate Professor of linguistics at Pomona Collegem about her work on the speech of American black/biracial young men, prosody and intonation, and what it means to sound black. We also talk about how Obama inadvertently provided her research topic, the linguistics of the Wu Tang Clan, and how linguistics can make the world a better place.

This month’s bonus episode is a recording of our liveshow about discourse markers in Montreal in September. What do “um” and “like” have in common with “behold” and “nevertheless”? They’re all discourse markers! These little words and phrases get a bad rap for being “meaningless”, but they’re actually really important. Find out how, and picture yourself sitting among real, live lingthusiasts in the excellent linguistics section at Argo Bookshop, on the recording. You can get access to it and previous bonuses about language games, hypercorrection, swearing, and teaching yourself linguistics by supporting Lingthusiasm on Patreon. patreon.com/lingthusiasm

For the links mentioned in this episode, check out our shownotes page at: http://lingthusiasm.com/post/166585412086/lingthusiasm-episode-13-what-does-it-mean-to

LINGTHUSIASM ANNIVERSARY UPDATE!
We’re excited to bring you our first interview episode right before our very special 1-year anniversary episode in November! To celebrate a whole year of enthusiastic linguistics podcasting, we’re aiming to hit another milestone at the same time: 100,000 listens across all episodes. We’re currently at 83k as of right before posting this episode, so it’s totally doable, but we need your help to get there! Here are some ways you can help: 

- Share a link to your favourite Lingthusiasm episode so far and say something about what you found interesting in it. If you link directly to the episode page on lingthusiasm.com, people can follow your link and listen even if they’re not normally podcast people. Can’t remember what was in each episode? Check out the quotes for memorable excerpts or transcripts for full episode text.  
- We appreciate all kinds of recs, including social media, blogs, newsletters, fellow podcasts, and recommending directly to a specific person who you think would enjoy fun conversations about language!  
- If you didn’t get around to listening to a couple episodes when they came out, now is a great time to get caught up! 
- Write a review on iTunes or wherever else you get your podcasts. The more reviews we have, the more that the Mighty Algorithms make us show up to other people browsing. Star ratings are great; star ratings with words beside them are even better. 

All of our listeners so far have come from word of mouth, and we’ve enjoyed hearing from so many of you how we’ve kept you company while folding laundry, walking the dog, driving to work, jogging, doing dishes, procrastinating on your linguistics papers, and so much more. But there are definitely still people out there who would be totally into making their mundane activities feel like a fascinating linguistics party, they just don’t know it’s an option yet. They need your help to find us!  

If you leave us a rec or review in public, we’ll thank you by name or pseudonym on our special anniversary post next month, which will live in perpetuity on our website. If you recommend us in private, we won’t know about it, but you can still feel a warm glow of satisfaction (and feel free to tell us about it on social media if you still want to be thanked!).

13: What Does it Mean to Sound Black? Intonation and Identity Interview with Nicole Holliday

Are you up for some prepositions? You might think you’re over prepositions, but have you ever really looked into them, or have you just gone by them? Other parts of speech notwithstanding, prepositions are something we’re really down with. 

In Episode 14 of Lingthusiasm, your hosts Gretchen McCulloch and Lauren Gawne introduce you to our favourite English grammar book, the mammoth, 1800-page Cambridge Grammar of the English Language (affectionately known as CGEL), and take a deep dive into its 60+ pages all about prepositions. We also explore how it is that a grammar can even have sixty pages of things to say about prepositions in a single language and how the tricky edge cases are what makes grammar so interesting. Plus, we look at cousins of the preposition in other languages, like case markers, postpositions, and even circumpositions, why prepositions are complicated to translate, and pied-piping, the prepositional structure named after a fairy tale.  

This month’s bonus episode is about how linguists solve the divisive question  of what makes a sandwich a sandwich. We introduce prototype theory to solve sandwiches, explain how bats and penguins relate to the idea of ‘birds’, and explore other meaning questions. You can get access to it and previous bonuses about discourse markers, language games, hypercorrection, teaching yourself linguistics, and more by supporting Lingthusiasm at patreon.com/lingthusiasm  

We also now have Lingthusiasm merch! Check out our soft, patterned IPA scarves in red, olive, and navy; shiny Lingthusiasm logo stickers; and mugs, t-shirts, and tote bags that say NOT JUDGING YOUR GRAMMAR, JUST ANALYSING IT at lingthusiasm.com/merch. 

Thanks so much to everyone who spent the month recommending and reviewing Lingthusiasm to celebrate our first anniversary this episode! We had the ambitious plan to get the show past 100,000 listens, but we knew we could only do it if you helped to introduce Lingthusiasm to new ears. You stepped up and helped us get there right on schedule! If you left a recommendation or review in public, we’ll thank you by name or pseudonym on our special anniversary post next week. If you recommended us in private, we obviously don’t know about it, but we hope you still feel a warm glow of satisfaction.

For the links mentioned in this episode, check out our shownotes page at: http://lingthusiasm.com/post/167572233831/lingthusiasm-episode-14-getting-into-up-for-and

14: Getting into, up for, and down with prepositions

My son counting to "eleventeen" at 35 months old.

Counting (age 2)

A podcast that's enthusiastic about linguistics by Gretchen McCulloch and Lauren Gawne. "A fascinating listen that will change the way you see everyday communications." –New York Times. "Joyously nerdy" –Buzzfeed.  

Weird and deep half-hour conversations about language on the third Thursday of the month.

Listened to all the episodes here and wish there were more? Want to talk with other people who are enthusiastic about linguistics? Get bonus episodes and access to our Discord community at www.patreon.com/lingthusiasm 
Shownotes and transcripts: www.lingthusiasm.com

98: Helping computers decode sentences - Interview with Emily M. Bender

Lingthusiasm

Related tracks