Machine Learning & Data Science

Linear Digressions

Data Science

Ray Kurzweil‘s impact on my life in general but especially on what I have been doing for the past 3 or 4 years is hard to exaggerate. It is a simple fact that, if I haven’t read his seminal book The Singularity is Near, I would be neither blogging nor podcasting about exponential technologies, not to mention going to Singularity University. And so it was with great excitement and some trepidation that I went to interview Dr. Kurzweil in his office in Boston.

Part of my trepidation came from some technical concerns: I wish I could buy a better camera. I wish I could hire a team of audio and video professionals so that I can focus on the interview itself. I wish I did a better job with the set up. I wish I had noticed that Ray’s lavalier mic has slipped out of its holder… The list is exponential. Still, if there is one thing that I’ve learned since I started podcasting is that we do get better. But it takes time. Meanwhile, my consolation is that eventually I will have to do another interview with Ray Kurzweil just so I get it right that time. For now, however, I hope that the content of this one will make up for its technical deficiencies.

During our conversation with Dr. Kurzweil we cover a wide variety of topics such as: how and why at age 5 Ray decided to become an inventor; his unique background of being born to Jewish parents but brought up in a Unitarian Church; his early interest in issues such as religious tolerance, poverty, social inequality and justice; 3D printing, open source, patents, progress and intellectual property rights; Watson, artificial intelligence, the Turing Test and human rights for AI, the technological singularity and some criticism thereof; his upcoming book How To Create A Mind and his Pattern Recognition Theory of Mind; the evolutionary advantages of intelligence; the benefits of reverse-engineering the human brain for the creation of AI and whether the latter would be interested in pondering and solving humanity’s greatest problems.

My favorite quote that I will take away from this interview with Ray Kurzweil is:

“Don’t be too concerned about what’s practical. Follow your passion and be who you would like to be.”

Ray Kurzweil on the Singularity: Be Who You Would Like To Be

Gary Marcus is not only a professor in psychology but also a computer scientist, programmer, AI researcher and best selling author. He recently wrote a critical article titled Ray Kurzweil’s Dubious New Theory of Mind that was publsihed by The New Yorker. After reading his blog post I thought that it will be interesting to invite Gary on Singularity 1 on 1 so that he can talk more about his argument.   

During our conversation with Gary we cover a wide variety of topics such as: what is psychology and how he got interested in it; his theory of mind in general and the idea that the mind is a kluge in particular; why the best approach to creating AI is at the bridge between neuroscience and psychology; other projects such as Henry Markram‘s Blue Brain, Randal Koene‘s Whole Brain Emulation, and Dharmendra Modha‘s SyNAPSE; Ray Kurzweil’s Patern Recognition Theory of Mind; Deep Blue, Watson and the lessons thereof; his take on the technological singularity and the ethics surrounding the creation of friendly AI…

Gary Marcus: How do we bridge the mind with the brain?!…

In the last episode, we zipped through neural nets and got a quick idea of how they work and why they can be so powerful. Here’s the real payoff of that work:

In this episode, we’ll talk about a brand-new pair of results, one from Stanford and one from Google, that use neural nets to perform automated picture captioning. One neural net does the object and relationship recognition of the image, a second neural net handles the natural language processing required to express that in an English sentence, and when you put them together you get an automated captioning tool. Two heads are better than one indeed...

Neural Nets (Part 2)

Let’s talk money. As a “hot” career right now, data science can pay pretty well. But for an individual person matched with a specific job or industry, how much should someone expect to make? 

Since Katie was on the job market lately, this was something she’s been researching, and it turns out that data science itself (in particular linear regressions) has some answers. 

In this episode, we go through a survey of hundreds of data scientists, who report on their job duties, industry, skills, education, location, etc. along with their salaries, and then talk about how this data was fed into a linear regression so that you (yes, you!) can use the patterns in the data to know what kind of salary any particular kind of data scientist might expect.

Careers in Data Science

O'Reilly's Jenn Webb chats with Cait O’Riordan, VP of product, music and platforms at Shazam, about the current state of predictive analytics and how Shazam is able to predict the success of a song, and how the Internet of Things affects Shazam’s product life cycles as well as the behaviors of their users. Jenn also chats with Francine Bennett, CEO and cofounder of Mastodon C, about unintentional uses of data for evil and how data scientists can ensure their work stays on the data for good side of that line.

How Shazam Predicts Pop Hits

O'Reilly's Ben Lorica chats with Mike Cafarella, assistant professor of computer science at the University of Michigan and co-founder of both Hadoop and Nutch.

From Search to Distributed Computing to Large-scale Information Extraction

In this special holiday episode of the O’Reilly Data Show, I look back at two conversations I had earlier this year at the Spark Summit in San Francisco. The first segment is an on-stage fireside chat with Ben Horowitz, co-founder of Andreessen Horowitz and author of The Hard Thing About Hard Things.

In the second segment, Reynold Xin, one of the architects of Apache Spark, explains the rise of Apache Spark in China.

Investing in Big Data Technologies

Open source software is ubiquitous throughout data science, and enables the work of nearly every data scientist in some way or another. Open source projects, however, are disproportionately maintained by a small number of individuals, some of whom are institutionally supported, but many of whom do this maintenance on a purely volunteer basis. The health of the data science ecosystem depends on the support of open source projects, on an individual and institutional level.

https://hdsr.mitpress.mit.edu/pub/xsrt4zs2/release/2

The Data Science Open Source Ecosystem

This is a re-release of an episode that originally ran in October 2019.

If you’re trying to manage a project that serves up analytics data for a few very distinct uses, you’d be wise to consider having custom solutions for each use case that are optimized for the needs and constraints of that use cases. You also wouldn’t be YouTube, which found themselves with this problem (gigantic data needs and several very different use cases of what they needed to do with that data) and went a different way: they built one analytics data system to serve them all. Procella, the system they built, is the topic of our episode today: by deconstructing the system, we dig into the four motivating uses of this system, the complexity they had to introduce to service all four uses simultaneously, and the impressive engineering that has to go into building something that “just works.”

Procella: YouTube's super-system for analytics data storage

A few weeks ago, we put out a call for data scientists interested in issues of race and racism, or people studying how those topics can be studied with data science methods, should get in touch to come talk to our audience about their work. This week we’re excited to bring on Todd Hendricks, Bay Area data scientist and a volunteer who reached out to tell us about his studies with the Stanford Open Policing dataset.

A Data Science Take on Open Policing Data

The data science and artificial intelligence community has made amazing strides in the past few years to algorithmically automate portions of the healthcare process. This episode looks at two computer vision algorithms, one that diagnoses diabetic retinopathy and another that classifies liver cancer, and asks the question—are patients now getting better care, and achieving better outcomes, with these algorithms in the mix? The answer isn’t no, exactly, but it’s not a resounding yes, because these algorithms interact with a very complex system (the healthcare system) and other shortcomings of that system are proving hard to automate away. Getting a faster diagnosis from an image might not be an improvement if the image is now harder to capture (because of strict data quality requirements associated with the algorithm that wouldn’t stop a human doing the same job). Likewise, an algorithm getting a prediction mostly correct might not be an overall benefit if it introduces more dramatic failures when the prediction happens to be wrong. For every data scientist whose work is deployed into some kind of product, and is being used to solve real-world problems, these papers underscore how important and difficult it is to consider all the context around those problems.

A Reality Check on AI-Driven Medical Assistants

All good things must come to an end, including this podcast. This is the last episode we plan to release, and it doesn’t cover data science—it’s mostly reminiscing, thanking our wonderful audience (that’s you!), and marveling at how this thing that started out as a side project grew into a huge part of our lives for over 5 years.

It’s been a ride, and a real pleasure and privilege to talk to you each week. Thanks, best wishes, and good night!

—Katie and Ben