The O'Reilly Data Show explores the opportunities and techniques driving big data and data science. Through interviews and analysis, we highlight the people putting data to work.

The O'Reilly Data Show Podcast

O'Reilly Radar

O'Reilly

queue

O'REILLY

In this episode of the Data Show, I spoke with Harish Doddi, co-founder and CEO of Datatron, a startup focused on helping companies deploy and manage machine learning models. As companies move from machine learning prototypes to products and services, tools and best practices for productionizing and managing models are just starting to emerge. Today’s data science and data engineering teams work with a variety of machine learning libraries, data ingestion, and data storage technologies. Risk and compliance considerations mean that the ability to reproduce machine learning workflows is essential to meet audits in certain application domains. And as data science and data engineering teams continue to expand, tools need to enable and facilitate collaboration.

As someone who specializes in helping teams turn machine learning prototypes into production-ready services, I wanted to hear what Doddi has learned while working with organizations that aspire to “become machine learning companies.”

Simplifying Machine Learning Lifecycle Management

In this episode of the Data Show, I spoke with Francesca Lazzeri, an AI and machine learning scientist at Microsoft, and her colleague Jaya Mathew, a senior data scientist at Microsoft. We conducted a couple of surveys this year—“How Companies Are Putting AI to Work Through Deep Learning” and “The State of Machine Learning Adoption in the Enterprise”—and we found that while many companies are still in the early stages of machine learning adoption, there’s considerable interest in moving forward with projects in the near future. Lazzeri and Mathew spend a considerable amount of time interacting with companies that are beginning to use machine learning and have experiences that span many different industries and applications. I wanted to learn some of the processes and tools they use when they assist companies in beginning their machine learning journeys.

Lessons Learned While Helping Enterprises Adopt Machine Learning

In this episode of the Data Show, I spoke with Vitaly Gordon, VP of data science and engineering at Salesforce. As the use of machine learning becomes more widespread, we need tools that will allow data scientists to scale so they can tackle many more problems and help many more people. We need automation tools for the many stages involved in data science, including data preparation, feature engineering, model selection and hyperparameter tuning, as well as monitoring.

I wanted the perspective of someone who is already faced with having to support many models in production. The proliferation of models is still a theoretical consideration for many data science teams, but Gordon and his colleagues at Salesforce already support hundreds of thousands of customers who need custom models built on custom data. They recently took their learnings public and open sourced TransmogrifAI, a library for automated machine learning for structured data, which sits on top of Apache Spark.

Building Tools for Enterprise Data Science

In this episode of the Data Show, I spoke with Alex Wong, associate professor at the University of Waterloo, and co-founder of DarwinAI, a startup that uses AI to address foundational challenges with deep learning in the enterprise. As the use of machine learning and analytics become more widespread, we’re beginning to see tools that enable data scientists and data engineers to scale and tackle many more problems and maintain more systems. This includes automation tools for the many stages involved in data science, including data preparation, feature engineering, model selection, and hyperparameter tuning, as well as tools for data engineering and data operations.

Wong and his collaborators are building solutions for enterprises, including tools for generating efficient neural networks and for the performance analysis of networks deployed to edge devices.

Tools for Generating Deep Neural Networks With Efficient Network Architectures

For the end-of-year holiday episode of the Data Show, I turned the tables on Data Show host Ben Lorica to talk about trends in big data, machine learning, and AI, and what to look for in 2019. Lorica also showcased some highlights from our upcoming Strata Data and Artificial Intelligence conferences.

Trends in Data, Machine Learning, and AI

In this episode of the Data Show, I spoke with Haoyuan Li, CEO and founder of Alluxio, a startup commercializing the open source project with the same name (full disclosure: I’m an advisor to Alluxio). Our discussion focuses on the state of Alluxio (the open source project that has roots in UC Berkeley’s AMPLab), specifically emerging use cases here and in China. Given the large-scale use in China, I also wanted to get Li’s take on the state of data and AI technologies in Beijing and other parts of China.

In the Age of AI, Fundamental Value Resides in Data

with James J. Collins, Vijay Pande (@vijaypande), and Hanne Tidnam (@omnivorousread)

The idea of 'designing biology' -- once science fiction -- has over the last 20 years become just... science. In this episode, a16z bio general partner Vijay Pande with Hanne Tidnam talk all about the field of synthetic biology with James J. Collins, professor of bioengineering at MIT. Collins, whose work in synthetic biology and systems biology pioneered the field, has also launched a number of companies and received numerous awards and honors (including a MacArthur "Genius" Award, an NIH Director's Pioneer Award, and Sanofi-Institut Pasteur Award).

This wide-ranging conversation about the birth of synthetic biology covers everything from the founding story of the discipline to what "engineering and designing" biology really looks like in action -- when instead of engineering electrons, you are engineering toggle switches for genes -- to the disciplinary differences (and synergies) between how biologists and engineers see the world. What are the engineering and design principles, techniques, approaches that work best when applied to science? How does building a company in this new space look different, in terms of platforms and products? And how is this new field changing education in science, all the way down to kits that allow you to play with the machinery of a cell... at home... and even in middle school?

a16z Podcast: All About Synthetic Biology

with Susannah Fox (@susannahfox), Anil Sethi (@anilsethiusa / @ciitizencorp), Vijay Pande (@vijaypande), and Sonal Chokshi (@smc90) 

The problem of "dark data" in healthcare isn't just a feel-good empowerment thing, but a structural issue that leads to miscommunication and extra friction, different players in the entire healthcare system not being able to collaborate with each other, and just major missed opportunities all round. And yes, it also leads to lack of empowerment for patients, not to mention doctors too (who often have less than 30 minutes on site to do their jobs).

But we already know all that. What's not clear is WHY and HOW is this the case, when the very point of HIPAA -- the Health Insurance Portability and Accountability Act (of 1996!) -- is to make data portable, not private. That is, IF patients know to ask for it... and can easily get it. So what if we could have a sort of permissioned "permissionless innovation" for healthcare data, not only bringing all that dark data to light, but more importantly -- borrowing from the history of internet innovation -- letting all sorts of expected and unexpected uses be built on top as a result? What happens when data and entities can talk to each other (à la APIs) through patients at the center of the circle of data?

From the Dr. Google problem (or opportunity!) to clinical trials and even the opioid crisis, we -- Susannah Fox (former CTO of the U.S. Department of Health and Human Services); Anil Sethi (CEO and founder of Ciitizen); and a16z bio general partner Vijay Pande; in conversation with Sonal Chokshi -- explore all this and more in this episode of the a16z Podcast. Let there be light!

a16z Podcast: Dark Data in Healthcare

In this episode of the Data Show, I spoke with Andrew Burt, chief privacy officer and legal engineer at Immuta, a company building data management tools tuned for data science. Burt and cybersecurity pioneer Daniel Geer recently released a must-read white paper (“Flat Light”) that provides a great framework for how to think about information security in the age of big data and AI. They list important changes to the information landscape and offer suggestions on how to alleviate some of the new risks introduced by the rise of machine learning and AI.

We discussed their new white paper, cybersecurity (Burt was previously a special advisor at the FBI), and an exciting new Strata Data tutorial that Burt will be co-teaching in March.

How Machine Learning Impacts Information Security

Veterinary oncology can inform human oncology, and vice versa -- providing a better model for looking at drug performance, interrelationships, and more. Especially when you add in data (there's no "doggy HIPAA!") and networks to get a "living laboratory at scale".

Or so argues Amy Abernethy (Chief Medical and Chief Scientific Officer at Flatiron Health and advisor to One Health), who was recently named the new Principal Deputy Commissioner of the FDA, pending ethics clearance; and Christina Lopes, CEO and co-founder of One Health; in conversation with a16z bio general partner Jorge Conde. Dogs -- as a species, as pets, as companions, as family members -- evolved alongside humans, so are actually more similar to us... not just genetically and in terms of the biologic pathways that may cause cancer, but also in exposure to similar environmental factors as well.

But what does this all mean when it comes to thinking about real-world evidence in science, human clinical trials, and more broadly, building a bio company? How can product designers -- of all kinds -- backwards-architect their product roadmap for data network effects? And how can bio founders keep both a big-picture roadmap in mind while also focusing on specific milestones, and while working across unconnected disciplines as well? We cover all this and more in this special episode of the a16z Podcast, recorded during the recent J.P.M. healthcare conference in San Francisco.

---

The views expressed here are those of the individual AH Capital Management, L.L.C. (“a16z”) personnel quoted and are not the views of a16z or its affiliates. Certain information contained in here has been obtained from third-party sources, including from portfolio companies of funds managed by a16z. While taken from sources believed to be reliable, a16z has not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation.
 
This content is provided for informational purposes only, and should not be relied upon as legal, business, investment, or tax advice. You should consult your own advisers as to those matters. References to any securities or digital assets are for illustrative purposes only, and do not constitute an investment recommendation or offer to provide investment advisory services. Furthermore, this content is not directed at nor intended for use by any investors or prospective investors, and may not under any circumstances be relied upon when making a decision to invest in any fund managed by a16z. (An offering to invest in an a16z fund will be made only by the private placement memorandum, subscription agreement, and other relevant documentation of any such fund and should be read in their entirety.) Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z, and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by Andreessen Horowitz (excluding investments and certain publicly traded cryptocurrencies/ digital assets for which the issuer has not provided permission for a16z to disclose publicly) is available at https://a16z.com/investments/.

Charts and graphs provided within are for informational purposes solely and should not be relied upon when making any investment decision. Past performance is not indicative of future results. The content speaks only as of the date indicated. Any projections, estimates, forecasts, targets, prospects, and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Please see https://a16z.com/disclosures for additional important information.

a16z Podcast: Connecting Hearts, Bodies, and Networks to Cure Cancer

In this episode of the Data Show, I spoke with Maryam Jahanshahi, research scientist at TapRecruit, a startup that uses machine learning and analytics to help companies recruit more effectively. In an upcoming survey, we found that a “skills gap” or “lack of skilled people” was one of the main bottlenecks holding back adoption of AI technologies. Many companies are exploring a variety of internal and external programs to train staff on new tools and processes. The other route is to hire new talent. But recent reports suggest that demand for data professionals is strong and competition for experienced talent is fierce. Jahanshahi and her team are building natural language and statistical tools that can help companies improve their ability to attract and retain talent across many key areas.

Using Machine Learning and Analytics to Attract and Retain Employees

with George Church (@geochurch) and Jorge Conde (@JorgeCondeBio)

Renowned scientist George Church is known for his groundbreaking work and methods used for the first genome sequence, and for his work in genome editing, writing & recoding -- in fact, Church’s innovations have become an essential building block for most of the DNA sequencing methods and companies we see today. In this conversation, a16z bio general partner Jorge Conde -- who also founded a company with Church out of the George Church Lab -- take us on a wild journey into the scientist’s mind and work, starting with what the leading pioneer in the space makes of where we are today with CRISPR (especially given recent news about CRISPR babies in China), to the broader implications of all of this on a cultural level, and finally to what it really takes to go from science fiction, to lab, to reality.

a16z Podcast: What's in the Water at the George Church Lab?

In this episode of the a16z Podcast -- which originally aired as a video on YouTube -- general partner Alex Rampell (and former fintech entrepreneur as the CEO and co-founder of TrialPay) talks with operating partner Frank Chen about the quickly changing fintech landscape and, even more importantly, why the landscape is changing now.

Should the incumbents be nervous? About what, exactly? And most importantly, what should big companies do about all of this change? But the conversation from both sides of the table begins from the perspective of the hungry and fast fintech startup sharing lessons learned, and then moves to more concrete advice for the execs in the hot seat at established companies.

---

The views expressed here are those of the individual AH Capital Management, L.L.C. (“a16z”) personnel quoted and are not the views of a16z or its affiliates.

This content is provided for informational purposes only, and should not be relied upon as legal, business, investment, or tax advice. You should consult your own advisers as to those matters. References to any securities or digital assets are for illustrative purposes only and do not constitute an investment recommendation or offer to provide investment advisory services. Furthermore, this content is not directed at nor intended for use by any investor or prospective investor, and may not under any circumstances be relied upon when making a decision to invest in any fund managed by a16z. (An offering to invest in an a16z fund will be made only by the private placement memorandum, subscription agreement, and other relevant documentation of any such fund which should be read in their entirety.)

Past performance is not indicative of future results. Any charts and graphs provided within are for informational purposes solely and should not be relied upon when making any investment decision. 

Please see https://a16z.com/disclosures for additional important information.

a16z Podcast: Fintech for Startups and Incumbents

In this episode of the Data Show, I spoke with Roger Chen, co-founder and CEO of Computable Labs, a startup focused on building tools for the creation of data networks and data exchanges. Chen has also served as co-chair of O'Reilly's Artificial Intelligence Conference since its inception in 2016. This conversation took place the day after Chen and his collaborators released an interesting new white paper, "Fair value and decentralized governance of data." Current-generation AI and machine learning technologies rely on large amounts of data, and to the extent they can use their large user bases to create “data silos,” large companies in large countries (like the U.S. and China) enjoy a competitive advantage. With that said, we are awash in articles about the dangers posed by these data silos. Privacy and security, disinformation, bias, and a lack of transparency and control are just some of the issues that have plagued the perceived owners of “data monopolies.”

Acquiring and Sharing High-Quality Data

In this episode of the Data Show, I speak with Cassie Kozyrkov, technical director and chief decision scientist at Google Cloud. She describes "decision intelligence" as an interdisciplinary field concerned with all aspects of decision-making, and which combines data science with the behavioral sciences. Most recently she has been focused on developing best practices that can help practitioners make safe, effective use of AI and data. Kozyrkov uses her platform to help data scientists develop skills that will enable them to connect data and AI with their organizations' core businesses.

We had a great conversation spanning many topics, including:

How data science can be more useful

The importance of the human side of data

The leadership talent shortage in data science

Is data science a bubble?

Make Data Science More Useful

In this episode of the Data Show, I speak with Alex Ratner, project lead for Stanford’s Snorkel open source project; Ratner also recently garnered a faculty position at the University of Washington and is currently working on a company supporting and extending the Snorkel project. Snorkel is a framework for building and managing training data. Based on our survey from earlier this year, labeled data remains a key bottleneck for organizations building machine learning applications and services.

Ratner was a guest on the podcast a little over two years ago when Snorkel was a relatively new project. Since then, Snorkel has added more features, expanded into computer vision use cases, and now boasts many users, including Google, Intel, IBM, and other organizations. Along with his thesis advisor professor Chris Ré of Stanford, Ratner and his collaborators have long championed the importance of building tools aimed squarely at helping teams build and manage training data. With today’s release of Snorkel version 0.9, we are a step closer to having a framework that enables the programmatic creation of training data sets.

Labeling, Transforming, and Structuring Training Data Sets for Machine Learning

In this episode of the Data Show, I speak with Kesha Williams, technical instructor at A Cloud Guru, a training company focused on cloud computing. As a full stack web developer, Williams became intrigued by machine learning and started teaching herself the ML tools on Amazon Web Services. Fast forward to today, Williams has built some well-regarded Alexa skills, mastered ML services on AWS, and has now firmly added machine learning to her developer toolkit.

Becoming a Machine Learning Practitioner

In this episode of the Data Show, I speak with Michael Mahoney, a member of RISELab, the International Computer Science Institute, and the Department of Statistics at UC Berkeley. A physicist by training, Mahoney has been at the forefront of many important problems in large-scale data analysis. On the theoretical side, his works spans algorithmic and statistical methods for matrices, graphs, regression, optimization, and related problems. On the applications side, he has contributed to systems used for internet and social media analysis, social network analysis, as well as for a host of applications in the physical and life sciences. Most recently, he has been working on deep neural networks, specifically developing theoretical methods and practical diagnostic tools that should be helpful to practitioners who use deep learning.

Understanding Deep Neural Networks

Jon Bruner and Mike Loukides talk about the classical music publishing industry and how it's being disrupted by projects like the Petrucci Music Library (http://imslp.org/) that make public-domain scores available online.

The future of classical music

Jim Stogdill, Edd Dumbill and Roger Magoulas have a conversation about in-memory databases and the impact on real time analysis. Leave questions and comments for us at http://radar.oreilly.com/2013/05/talking-about-in-memory.html

Talking about in-memory

Jon Bruner, Mike Loukides and Jim Stogdill from O'Reilly Radar muse on the return of software to the physical world.

Software and the physical world

Jon Bruner, Jim Stogdill, and Roger Magoulas talk about anthropology in big data, advances in JavaScript, searching for ancient civilizations, the importance of context, and good sites for checking the weather.

Related blog post: http://radar.oreilly.com/2013/06/radar-podcast-anthropology-big-data-and-the-importance-of-context.html

Anthropology, big data, and the importance of context

Jon Bruner, Jim Stogdill, and Roger Magoulas talk about what's been on their minds this week: the NSA's surveillance programs, what defense contractors will do with their technology as defense budgets dry up, and a Californian who isn't doing what you think he's doing with hydroponics.

For more on these topics, and links to the things we talked about, see http://radar.oreilly.com/2013/06/radar-podcast-the-internet-of-things-prism-and-defense-technology-that-goes-civilian.html.

The Internet of Things, PRISM, and defense technology that goes civilian

O'Reilly Media spreads the knowledge of innovators. At O’Reilly, a big part of our business is paying attention to what’s new and interesting in the world of technology. We have a pretty good record at having anticipated some of the big technology developments in recent history. For instance, we launched the first commercial Web site, GNN, in 1993; we organized the meeting at which the term “open source” was first adopted; we were early investors in Blogger, which helped launch the blogging revolution; and more recently, our Web 2.0 conference launched a world-wide meme. We call this predictive sense the “O’Reilly Radar.” And while we’re certainly not always right, we are, at least, good at making interesting guesses.

Our methodology is simple: we draw from the wisdom of the alpha geeks in our midst, paying attention to what’s interesting to them, amplifying these weak signals, and seeing where they fit into the innovation ecology. Add to that the original research conducted by our Research team, and you start to get a good picture of what the technology world is thinking about.