In this special episode, we chatted with Chris Callison-Burch about his testimony in the recent U.S. Congress Hearing on the Interoperability of AI and Copyright Law. We started by asking Chris about the purpose and the structure of this hearing. Then we talked about the ongoing discussion on how the copyright law is applicable to content generated by AI systems, the potential risks generative AI poses to artists, and Chris’ take on all of this. We end the episode with a recording of Chris’ opening statement at the hearing.

140 - Generative AI and Copyright, with Chris Callison-Burch

In this special episode of NLP Highlights, we discussed building and open sourcing language models. What is the usual recipe for building large language models? What does it mean to open source them? What new research questions can we answer by open sourcing them? We particularly focused on the ongoing Open Language Model (OLMo) project at AI2, and invited Iz Beltagy and Dirk Groeneveld, the research and engineering leads of the OLMo project to chat.

Blog post announcing OLMo: https://blog.allenai.org/announcing-ai2-olmo-an-open-language-model-made-by-scientists-for-scientists-ab761e4e9b76

Organizations interested in partnership can express their interest here: https://share.hsforms.com/1blFWEWJ2SsysSXFUEJsxuA3ioxm

You can find Iz at twitter.com/i_beltagy and Dirk at twitter.com/mechanicaldirk

141 - Building an open source LM, with Iz Beltagy and Dirk Groeneveld

Our first guest with this new format is Kyle Lo, the most senior lead scientist in the Semantic Scholar team at Allen Institute for AI (AI2), who kindly agreed to share his perspective on #Science of #Science (#scisci) on our podcast. SciSci is concerned with studying how people do science, and includes developing methods and tools to help people consume AND produce science. Kyle has made several critical contributions in this field which enabled a lot of SciSci work over the past 5+ years, ranging from novel NLP methods (eg, SciBERT https://lnkd.in/gTP_tYiF ), to open data collections (eg, S2ORK https://lnkd.in/g4J6tXCG), to toolkits for manipulating scientific documents (eg, PaperMage https://lnkd.in/gwU7k6mJ which JUST received a Best Paper Award 🏆 at EMNLP 2023).

Kyle Lo's homepage: https://kyleclo.github.io/

142 - Science Of Science, with Kyle Lo

This podcast episode features Dr. Mohamed Elhoseiny, a true luminary in the realm of computer vision with over a decade of groundbreaking research. As an Assistant Professor at KAUST, Dr. Elhoseiny's work delves into the intersections of Computer Vision, Language & Vision, and Computational Creativity in Art, Fashion, and AI. Notably, he co-organized the 1st and 2nd Workshops on Closing the Loop between Vision and Language, demonstrating his commitment to advancing interdisciplinary research. With a rich educational background from Stanford University's Graduate School of Business Ignite Program, and Rutgers University as MS/PhD Researcher, coupled with influential stints at Stanford, Baidu Research, Facebook AI Research, Adobe Research, and SRI International, Dr. Elhoseiny brings a wealth of experience to our discussion.

"Imaginative AI" with Mohamed Elhoseiny

Curious about the safety of LLMs? 🤔 Join us for an insightful new episode featuring Suchin Gururangan, Young Investigator at Allen Institute for Artificial Intelligence and Data Science Engineer at Appuri. 🚀 Don't miss out on expert insights into the world of LLMs!

Are LLMs safe?

Wouldn’t it solve so many problems in the world if everyone just spoke the same language? Not so fast! 

Lingthusiasm is a brand-new podcast that’s enthusiastic about linguistics, hosted by Lauren Gawne of Superlinguo​ and Gretchen McCulloch of All Things Linguistic.

In this first episode of Lingthusiasm, ​Gretchen and Lauren discuss the “one language equals peace” fallacy, and whether speaking the same words means that people will necessarily agree with each other (spoiler: no). But the history of how people have tried is still really interesting, from constructed and symbolic communication like Blissymbols and emoji to the way astronauts communicate in the high stakes environment of the International Space Station.

For links to things mentioned during this episode visit http://lingthusiasm.com/post/154520059101/lingthusiasm-episode-1-speaking-a-single-language

Listen to bonus episodes, suggest future topics, and help keep the show ad-free by supporting us on Patreon: http://patreon.com/lingthusiasm

01: Speaking a single language won’t bring about world peace

There are some pretty funny quotes of historical people complaining about kids back then doing linguistic things that now seem totally unremarkable. So let’s cut to the chase and celebrate linguistic innovation while it’s happening. 

In episode 7 of Lingthusiasm, your hosts Lauren Gawne and Gretchen McCulloch explore how far back we can trace complaints about the language of Kids These Days, why linguistic discrimination is harmful, and why “be like”, hyperbolic “literally”, and other modern innovations are actually signs of something awesome. 

We also announce a Patreon to keep the podcast sustainable! You can support us there to listen to a bonus episode about swearing and future monthly bonus content, and help decide the topics of future episodes. Even if you’re not sure about pledging, do check out the Patreon goals to see some of our future plans and our video to see a totally realistic and not at all staged cameo from our producer. Check out http://patreon.com/lingthusiasm 

For more information visit the show page: http://lingthusiasm.com/post/159796192161/lingthusiasm-episode-7-kids-these-days-arent

07: Kids these days aren’t ruining language

How do we get from knowing words to making brand-new sentences out of them? In episode 9 of Lingthusiasm, your hosts Gretchen McCulloch and Lauren Gawne talk about how words form groups with other words: constituency. 

Once you start looking for it, constituency is everywhere: in ambiguous sentences like “time flies like an arrow; fruit flies like a banana”, in remixed films like “Of Oz The Wizard”, and even internet dog memes.

This month’s Patreon bonus was the backstory about the linguistics of the doggo meme and its connection to Australian slang, which grew out of this NPR article about doggo. You can get access to it and previous bonuses about swearing, teaching yourself linguistics, and explaining linguistics to employers by supporting Lingthusiasm on Patreon.

For more information, and links to things mentioned in this episode, visit the show page: http://lingthusiasm.com/post/161859273886/lingthusiasm-episode-9-the-bridge-between-words

09: The bridge between words and sentences - Constituency

Some linguists work with multiple languages, while others focus on just one. But for many people, learning a language after early childhood is the thing that first gets them curious about how language works in general and all the things in their native language(s) that they take for granted. 

In episode 10 of Lingthusiasm, your hosts Gretchen McCulloch and Lauren Gawne talk about how learning languages can feed into linguistics and vice versa. We also explore the power dynamics that affect learning languages, and the importance of learning about the rules of interaction as well as the rules of grammar.

This month’s Patreon bonus was about hypercorrection, where you try so hard to follow a linguistic rule that you end up overshooting. You can get access to it and previous bonuses about the doggo meme, swearing, teaching yourself linguistics, and explaining linguistics to employers by supporting Lingthusiasm on Patreon. http://patreon.com/lingthusiasm

Gretchen’s new recorder in this episode is thanks to the support of our patrons! 

For more information, and links to things mentioned in this episode, visit the show page: http://lingthusiasm.com/post/163226798571/lingthusiasm-episode-10-learning-languages

10: Learning languages linguistically

TACL 2018 paper by Jacob Buckman and Graham Neubig. 

Jacob tells us about marginalizing over latent structure in a sentence by doing a clever parameterization of a lattice with a model kind of like a tree LSTM.  This lets you treat collocations as multi-word units, or allow words to have multiple senses, without having to commit to a particular segmentation or word sense disambiguation up front.  We talk about how this works and what comes out.  One interesting result that comes out of the sense lattice: learning word senses from a language modeling objective tends to give you senses that capture the mode of the "next word" distribution, like uses of "bank" that are always followed by "of".  Helpful for local perplexity, but not really what you want if you're looking for semantic senses, probably.

https://www.semanticscholar.org/paper/Neural-Lattice-Language-Models-Buckman-Neubig/f36b961ea5106c19c341763bd9942c1f09038e5d

Jacob Buckman

63 - Neural Lattice Language Models, with Jacob Buckman

NAACL 2018 paper, by Rachel Rudinger, Aaron Steven White, and Benjamin Van Durme

Rachel comes on to the podcast, telling us about what factuality is (did an event happen?), what datasets exist for doing this task (a few; they made a new, bigger one), and how to build models to predict factuality (turns out a vanilla biLSTM does quite well).  Along the way, we have interesting discussions about how you decide what an "event" is, how you label factuality (whether something happened) on inherently uncertain text (like "I probably failed the test"), and how you might use a system that predicts factuality in some end task.

https://www.semanticscholar.org/paper/Neural-models-of-factuality-Rudinger-White/4d62a1e7819f9e3f8c837832c66659db5a6d9b37

68 - Neural models of factuality, with Rachel Rudinger

**The podcast is currently on hiatus. For more active NLP content, check out the Holistic Intelligence Podcast linked below.**

Welcome to the NLP highlights podcast, where we invite researchers to talk about their work in various areas in natural language processing. All views expressed belong to the hosts/guests, and do not represent their employers.

63 - Neural Lattice Language Models, with Jacob Buckman

NLP Highlights

Related tracks