interesting podcasts tbl

One of the most memorable moments from this interview is when our guest mentioned that Larry Page hired him to solve intelligence; very few people can say this, and this says something about today’s guest, Dr. Nando de Freitas - a senior researcher at Google and professor at Oxford - as well as the gravity of his present work. Today, I speak with Nando about a topic well known through his research at Google, deep learning. de Freitas gives his perspective on the basics of deep learning, the applications in conversational interfaces and recognizing images and videos, and what the future of this technology might look like in the nearer future.

DeepMind's Nando de Freitas - Why Deep Learning is Like Building with Legos

In this episode of the Data Show, I spoke with Jeremy Stanley, VP of data science at Instacart, a popular grocery delivery service that is expanding rapidly. As Stanley describes it, Instacart operates a four-sided marketplace comprised of retail stores, products within the stores, shoppers assigned to the stores, and customers who order from Instacart. The objective is to get fresh groceries from popular retailers delivered to customers in a timely fashion. Instacart’s goals land them in the center of the many opportunities and challenges involved in building high-impact data products.

Data Science and Deep Learning in Retail

Kullback Leibler divergence, or KL divergence, is a measure of information loss when you try to approximate one distribution with another distribution.  It comes to us originally from information theory, but today underpins other, more machine-learning-focused algorithms like t-SNE.  And boy oh boy can it be tough to explain.  But we're trying our hardest in this episode!

KL Divergence

Even as we rely more and more on machine learning algorithms to help with everyday decision-making, we're learning more and more about how they're frighteningly easy to fool sometimes.  Today we have a roundup of a few successful efforts to create robust adversarial examples, including what it means for an adversarial example to be robust and what this might mean for machine learning in the future.

Adversarial Examples

Autoencoders are neural nets that are optimized for creating outputs that... look like the inputs to the network. Turns out this is a not-too-shabby way to do unsupervised machine learning with neural nets.

Autoencoders

Data science and analytics are hot topics in business these days, but for a lot of folks looking to bring data into their organization, it can be hard to know where to start and what it looks like when they're succeeding. That was the motivation for writing a whitepaper on the analytics maturity of an organization, and that's what we're talking about today. In particular, we break it down into five attributes of an organization that contribute (or not) to their success in analytics, and what each of those mean and why they matter. 

Whitepaper here:
bit.ly/analyticsmaturity

Analytics Maturity

Last week’s episode, about methods for optimized web crawling logic, left off on a bit of a cliffhanger: the data scientists had found a solution to the problem, but it wasn’t something that the engineers (who own the search codebase, remember) liked very much. It was black-boxy, hard to parallelize, and introduced a lot of complexity to their code. This episode takes a second crack, where we formulate the problem a little differently and end up with a different, arguably more elegant solution. 

Relevant links:
http://www.unofficialgoogledatascience.com/2018/07/by-bill-richoux-critical-decisions-are.html
http://www.csc.kth.se/utbildning/kth/kurser/DD3364/Lectures/KKT.pdf

Optimized Optimized Web Crawling

When you think about it, it’s pretty amazing that we can draw conclusions about huge populations, even the whole world, based on datasets that are comparatively very small (a few thousand, or a few hundred, or even sometimes a few dozen). That’s the power of statistics, though. This episode is kind of a two-for-one but we’re excited about it—first we’ll talk about the Normal or Gaussian distribution, which is maybe the most famous probability distribution function out there, and then turn to the Central Limit Theorem, which is one of the foundational tenets of statistics and the real reason why the Normal distribution is so important.

The Normal Distribution and the Central Limit Theorem

Convex optimization is one of the keys to data science, both because some problems straight-up call for optimization solutions and because popular algorithms like a gradient descent solution to ordinary least squares are supported by optimization techniques. But there are all kinds of subtleties, starting with convex and non-convex functions, why gradient descent is really an optimization problem, and what that means for your average data scientist or statistician.

Convex (and non-convex) Optimization

We’re taking a break for the holidays, chilling with the dog and an eggnog (Katie) and the cat and some spiced cider (Ben). Here’s an episode from a while back for you to enjoy. See you again in 2019!

You might sometimes find that it's hard to get started doing something, but once you're going, it gets easier. Turns out machine learning algorithms, and especially recommendation engines, feel the same way. The more they "know" about a user, like what movies they watch and how they rate them, the better they do at suggesting new movies, which is great until you realize that you have to start somewhere. The "cold start" problem will be our focus in this episode, both the heuristic solutions that help deal with it and a bit of realism about the importance of skepticism when someone claims a great solution to cold starts.

Re - Release: The Cold Start Problem

Bringing you another old classic this week, as we gear up for 2019! See you next week with new content.

Word2Vec is probably the go-to algorithm for vectorizing text data these days.  Which makes sense, because it is wicked cool.  Word2Vec has it all: neural networks, skip-grams and bag-of-words implementations, a multiclass classifier that gets swapped out for a binary classifier, made-up dummy words, and a model that isn't actually used to predict anything (usually).  And all that's before we get to the part about how Word2Vec allows you to do algebra with text.  Seriously, this stuff is cool.

Re-release: Word2Vec

Welcome to episode 1 of our Ace Data Science Interviews podcast! In this episode, Kunal introduces the idea behind this concept and why we believe this podcast, and this platform, are more necessary than ever before. Kunal has conducted hundreds of interviews over the last 10+ years so who better to guide you on your data science journey?

We will also look at the top 3 mistakes data scientists commonly make in interviews. What an important topic to kick things off!

Episode #1: Top 3 Mistakes Data Scientists Make in Interviews

A lot of AI in the press is CMOs or marketing people talking about what a company can do in a way that really is aspirational. They're speaking about what they can do, but in reality, the things that they're talking about, the capabilities won't be unlocked for maybe a year or more. These are just things on the technology road map, but people speak about them like they exist now. This week, we speak with Abinash Tripathy, founder and&nbsp;Chief Strategy Officer at Help Shift. They've raised upwards of $40,000,000 in the last six years to apply artificial intelligence to the future of  customer service, and we speak about the hard challenges of  chatbots and conversational interfaces, as well as how long it's going to be until those are actually robust. This in opposition to how people at large companies might put out a press release touting their own chatbots that simply aren't capable of doing what they say they can to any meaningful degree. We also talk about where AI can augment and make a difference in existing customer service workflows.&nbsp; Even if we can't have all-capable chatbots to handle banking or  insurance or  eCommerce questions from people, where can AI easily slide it's way in and actually make a difference today? In this episode, we draw a firm line on where the technology currently stands. Overall, though, this episode is about the challenges of actually innovating in AI. We talk about why it really is the big companies that do a lot of the actual cutting edge breakthroughs of AI and why others are going to have to license those their technologies from large firms like Google and Amazon. We also discuss why companies maybe need to have a realistic expectation about where they can apply AI, as well as why actually innovating and coming up with new AI capabilities on their own might just be wholly unreasonable given their data, their company culture, and their density of AI talent. Read the full interview article on emerj.com

Why It's Exceedingly Difficult to Build and Adopt AI in Business

It’s time for our latest installation in the series on artificial intelligence agents beating humans at games that we thought were safe from the robots. In this case, the game is StarCraft, and the AI agent is AlphaStar, from the same team that built the Go-playing AlphaGo AI last year. StarCraft presents some interesting challenges though: the gameplay is continuous, there are many different kinds of actions a player must take, and of course there’s the usual complexities of playing strategy games and contending with human opponents. AlphaStar overcame all of these challenges, and more, to notch another win for the computers.

AlphaStar

OpenAI recently created a cutting-edge new natural language processing model, but unlike all their other projects so far, they have not released it to the public. Why? It seems to be a little too good. It can answer reading comprehension questions, summarize text, translate from one language to another, and generate realistic fake text. This last case, in particular, raised concerns inside OpenAI that the raw model could be dangerous if bad actors had access to it, so researchers will spend the next six months studying the model (and reading comments from you, if you have strong opinions here) to decide what to do next. Regardless of where this lands from a policy perspective, it’s an impressive model and the snippets of released auto-generated text are quite impressive. We’re covering the methodology, the results, and a bit of the policy implications in our episode this week.

The Language Model Too Dangerous to Release

How has data science implementation in government helped improve your community? 

If you enjoyed this episode, check out show notes, resources, and more at www.superdatascience.com/248

The Super Data Science Podcast: Big Data | Analytics Careers | Mentors | Success

SDS 248: Data Science in Government

If you work in data science, you’re well aware of the sheer volume of high-risk, high-reward projects that are hypothetically possible. The fact that they’re high-reward means they’re exciting to think about, and the payoff would be huge if they succeed, but the high-risk piece means that you have to be smart about what you choose to work on and be wary of investing all your resources in projects that fail entirely or starve other, higher-value projects. 

This episode focuses mainly on Google X, the so-called “Moonshot Factory” at Google that is a modern-day heir to the research legacies of Bell Labs and Xerox PARC. It’s an organization entirely focused on rapidly imagining, prototyping, invalidating, and, occasionally, successfully creating game-changing technologies. The process and philosophy behind Google X are useful for anyone thinking about how to stay aggressive and “responsibly irresponsible,” which includes a lot of you data science folks out there.

Google X, and Taking Risks the Smart Way

If you’re like most software engineers and, especially, data scientists, you find it really hard to make accurate estimates of how long a project will take to complete. Don’t feel bad: statistics is most likely actively working against your best efforts to give your boss an accurate delivery date. This week, we’ll talk through a great blog post that digs into the underlying probability and statistics assumptions that are probably driving your estimates, versus the ones that maybe should be driving them. 

Relevant links:

https://erikbern.com/2019/04/15/why-software-projects-take-longer-than-you-think-a-statistical-model.html

Estimating Software Projects, and Why It's Hard

In this episode of the SuperDataScience Podcast, I chat with Eoin Murray, the founder of Kyso.io, a platform where you can blog about your data science projects using tools such as Jupyter notebooks. You will learn what the platform means for data scientists and how you can use it to build your online presence and online portfolio. You will hear about startups and how you can jump into creating a startup, what accelerators are, what angel investors are, what venture capital funds are. And you will also hear where data science is going and whether or not data science should be a certified profession.

If you enjoyed this episode, check out show notes, resources, and more at www.superdatascience.com/263

SDS 263: Communicating Data

This week’s episode is a special one, as we’re welcoming a guest: Joel Grus is a data scientist with a strong software engineering streak, and he does an impressive amount of speaking, writing, and podcasting as well. Whether you’re a new data scientist just getting started, or a seasoned hand looking to improve your skill set, there’s something for you in Joel’s repertoire.

interesting podcasts tbl

Alihan Zıhna