The O'Reilly Media Podcast spreads the knowledge of innovators. At O’Reilly, a big part of our business is paying attention to what’s new and interesting in the world of technology. The O'Reilly Media Podcast features interviews with the people working on the forefront of technology.

O'Reilly Media Podcast

play list

data stuff

Data Streaming

it_listen

digital transformation

Reilly

O'REILLY

O'Reilly's Ben Lorica talks with Mikio Braun about machine learning, stream processing and analytics, his recent foray into data science training, and academia versus industry.

Building Big Data Systems in Academia and Industry

"Machine learning is to big data as human learning is to life experience," says Christopher Nguyen, the co-founder and CEO of big data intelligence company Adatao. Sure, but then, what IS big data? (especially as it's become a buzzword that captures so many things)... 

On this episode of the a16z Podcast, Nguyen puts on his former computer science professor hat to describe 'big data' in relation to 'machine learning' -- as well as what comes next with 'deep learning'. Finally, the former Google exec shares how Hadoop and Spark evolved from the efforts of companies dealing with massive amounts of real-time information; what we need to make machine learning a property of every application (why would we even want to?); and how we can make all this intelligence accessible to everyone.

–––

The views expressed here are those of the individual AH Capital Management, L.L.C. (“a16z”) personnel quoted and are not the views of a16z or its affiliates. Certain information contained in here has been obtained from third-party sources, including from portfolio companies of funds managed by a16z. While taken from sources believed to be reliable, a16z has not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation.
 
This content is provided for informational purposes only, and should not be relied upon as legal, business, investment, or tax advice. You should consult your own advisers as to those matters. References to any securities or digital assets are for illustrative purposes only, and do not constitute an investment recommendation or offer to provide investment advisory services. Furthermore, this content is not directed at nor intended for use by any investors or prospective investors, and may not under any circumstances be relied upon when making a decision to invest in any fund managed by a16z. (An offering to invest in an a16z fund will be made only by the private placement memorandum, subscription agreement, and other relevant documentation of any such fund and should be read in their entirety.) Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z, and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by Andreessen Horowitz (excluding investments and certain publicly traded cryptocurrencies/ digital assets for which the issuer has not provided permission for a16z to disclose publicly) is available at https://a16z.com/investments/.

Charts and graphs provided within are for informational purposes solely and should not be relied upon when making any investment decision. Past performance is not indicative of future results. The content speaks only as of the date indicated. Any projections, estimates, forecasts, targets, prospects, and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Please see https://a16z.com/disclosures for additional important information.

a16z Podcast: Making Sense of Big Data, Machine Learning, and Deep Learning

O'Reilly's Mike Hendrickson chats with database pioneer and 2014 Turing Award recipient Michael Stonebraker about winning the award, the future of data science, and the importance — and difficulty — of data curation.

The Future of Data at Scale

Google engineer Tyler Akidau on the evolution of stream processing, the challenges of building systems that scale to massive data sets, and the recent surge in interest in all things real time.

Building Systems for Massive Scale Data Applications

In episode twenty two we talk with Adam Kalai of Microsoft Research New England about his work using crowdsourcing in Machine Learning, the language made of shapes of words, and New England Machine Learning Day. We take a look at the workshops being presented at NIPS this year, and we take a listener question about changing the number of features your data has.

Workshops At NIPS And Crowdsourcing In Machine Learning

In this special holiday episode of the O’Reilly Data Show, I look back at two conversations I had earlier this year at the Spark Summit in San Francisco. The first segment is an on-stage fireside chat with Ben Horowitz, co-founder of Andreessen Horowitz and author of The Hard Thing About Hard Things.

In the second segment, Reynold Xin, one of the architects of Apache Spark, explains the rise of Apache Spark in China.

Investing in Big Data Technologies

In this O’Reilly Podcast, Ben Lorica talks with John Hugg, founding engineer and manager of developer outreach at VoltDB. From the deluge of today's diverse data, Hugg describes how to extract meaningful information to make things cheaper and faster.

Streaming data + stream processing = information

In this episode of the O’Reilly Podcast, O’Reilly’s Ben Lorica sat down with Ben Sharma, CEO and co-founder of Zaloni, an organization that provides enterprise data management solutions for Hadoop. They discussed real-time data processing, the changing nature of data, sentiment analysis, and the trend toward combining cloud with on-prem infrastructures.


Approaching Big Data From a Business Perspective

In this episode of the O’Reilly Data Show, I spoke with M.C. Srivas, co-founder of MapR and currently chief architect for data at Uber. We discussed his long career in data management and his experience building a variety of distributed systems. In the course of his career, Srivas has architected key components that now comprise many data platforms (distributed file system, database, query engine, messaging system, etc.).

Stream Processing and Messaging Systems for the IoT Age

In this episode of the O’Reilly Data Show, O’Reilly’s online managing editor Jenn Webb speaks with Natalino Busa on the topic of predictive analytics, the challenges of feature engineering, and a new class of techniques that is enabling features to emerge from patterns within the data. They also discuss the relationship between predictive techniques and high-quality microservices, and how machine learning is being used to improve financial services.

Understanding Predictive Analytics

In this episode of the O’Reilly Hardware Podcast, Brian Jepson and I speak with Mike Vladimer, co-founder of the Orange IoT Studio at Orange Silicon Valley. Vladimer discusses how Internet of Things devices could benefit from connectivity options other than those provided by well-known technologies (including cellular, WiFi, and Bluetooth), and explains the LoRa wireless protocol, which supports long-range and lower-power applications.

Mike Vladimer on IoT Connectivity

In this episode of the Data Show, I spoke with Anima Anandkumar, a leading machine learning researcher, and currently a principal research scientist at Amazon. I took the opportunity to get an update on the latest developments on the use of tensors in machine learning. Most of our conversation centered around MXNet—an open source, efficient, scalable deep learning framework. I’ve been a fan of MXNet dating back to when it was a research project out of CMU and UW, and I wanted to hear Anandkumar’s perspective on its recent progress as a framework for enterprises and practicing data scientists.

Deep Learning That's Easy to Implement and Easy to Scale

In this episode of the Data Show, I spoke with Francisco Webber, founder of Cortical.io, a startup that is applying tools based on Hierarchical Temporal Memory (HTM) to natural language understanding. While HTM has been around for more than a decade, there aren’t many companies that have released products based on it (at least compared to other machine learning methods). Numenta, an organization developing open source machine intelligence based on the biology of the neocortex, maintains a community site featuring showcase applications. Webber’s company has been building tools based on HTM and applying them to big text data in a variety of industries; financial services has been a particularly strong vertical for Cortical.

Natural Language Analysis Using Hierarchical Temporal Memory

In this episode of the Data Show, I spoke with Aurélien Géron, a serial entrepreneur, data scientist, and author of a popular, new book entitled "Hands-on Machine Learning with Scikit-Learn and TensorFlow." Géron’s book is aimed at software engineers who want to learn machine learning and start deploying machine learning models in real-world products.

Becoming a Machine Learning Engineer

When I first discovered and started using Apache Spark, a majority of the use cases I used it for involved unstructured text. The absence of libraries meant rolling my own NLP utilities, and, in many cases, implementing a machine learning library (this was pre deep learning, and MLlib was much smaller). I’d always wondered why no one bothered to create an NLP library for Spark when many people were using Spark to process large amounts of text. The recent, early success of BigDL confirms that users like the option of having native libraries.

In this episode of the Data Show, I spoke with David Talby of Pacific.AI, a consulting company that specializes in data science, analytics, and big data. A couple of years ago I mentioned the need for an NLP library within Spark to Talby; he not only agreed, he rounded up collaborators to build such a library. They eventually carved out time to build the newly released Spark NLP library. Judging by the reception received by BigDL and the number of Spark users faced with large-scale text processing tasks, I suspect Spark NLP will be a standard tool among Spark users.

STRATA DATA CONFERENCE


Strata Data Conference in San Jose, March 5-8, 2018
Registration is now open 
Talby and I also discussed his work helping companies build, deploy, and monitor machine learning models. Tools and best practices for model development and deployment are just beginning to emerge—I summarized some of them in a recent post, and, in this episode, I discussed these topics with a leading practitioner.

Building a Natural Language Processing Library for Apache Spark

In a recent episode of the O’Reilly Media Podcast, we spoke with George Miranda about the importance of service mesh technology in creating reliable distributed systems. As discussed in the new report The Service Mesh: Resilient Service-to-Service Communication for Cloud Applications, service mesh technology has emerged as a popular tool for companies looking to build cloud-native applications that are reliable and secure.

During the podcast, we discussed the problems a service mesh infrastructure solves and the service mesh features you’ll find most valuable. We also talked about how to choose the right service mesh for your organization, the challenges involved in getting it deployed to production, and the best ways for getting started with a service mesh.

How to Choose and Deploy a Service Mesh

In this episode of the O’Reilly Media Podcast, Rachel Roumeliotis, VP of content strategy at O’Reilly, sat down with Daniel Krook, IBM developer advocate. They discussed how developers across industries can participate in the Call for Code initiative, the benefits of the program, support from its charitable partners—United Nations Human Rights and the American Red Cross—and the positive impacts IBM hopes to achieve by investing in Call for Code.

Developers Worldwide Will Collaborate on Solutions to Save Lives in Call For Code

This episode of the O’Reilly Podcast, features a conversation on serverless and Kubernetes, with Kelsey Hightower, developer advocate for Google Cloud Platform at Google (and co-author of "Kubernetes: Up and Running"), and Chris Gaun, Kubernetes product marketing manager at Mesosphere.

Kelsey Hightower and Chris Gaun on Serverless and Kubernetes

In this episode of the Data Show, I spoke with Kartik Hosanagar, professor of technology and digital business, and professor of marketing at The Wharton School of the University of Pennsylvania.  Hosanagar is also the author of a newly released book, "A Human’s Guide to Machine Intelligence," an interesting tour through the recent evolution of AI applications, which draws from his extensive experience at the intersection of business and technology.

Algorithms Are Shaping Our Lives—Here's How We Wrest Back Control

At Google’s 2019 Cloud Next conference, I sat down with Stephen Thorne, site reliability engineer on Google’s customer reliability engineering team and co-author of "The Site Reliability Workbook," to talk about how organizations, both large and small, can use SRE to reduce operational costs, improve reliability, and create productive cross-functional teams.

How to Get Started With Site Reliability Engineering (SRE)

In this interview, Tim Craig and fellow Googler Gustavo Franco, a site reliability engineer (SRE), discuss the wide range of events that qualify as “incidents;” the need for a conscious, robust, and well-defined process for understanding them; the role of training; and how to get buy-in from management so you can spread incident response training throughout an organization.

Taming Chaos: Preparing for Your Next Incident

Jon Bruner and Mike Loukides talk about the classical music publishing industry and how it's being disrupted by projects like the Petrucci Music Library (http://imslp.org/) that make public-domain scores available online.

The future of classical music

Jim Stogdill, Edd Dumbill and Roger Magoulas have a conversation about in-memory databases and the impact on real time analysis. Leave questions and comments for us at http://radar.oreilly.com/2013/05/talking-about-in-memory.html

Talking about in-memory

Jon Bruner, Mike Loukides and Jim Stogdill from O'Reilly Radar muse on the return of software to the physical world.

Software and the physical world

Jon Bruner, Jim Stogdill, and Roger Magoulas talk about anthropology in big data, advances in JavaScript, searching for ancient civilizations, the importance of context, and good sites for checking the weather.

Related blog post: http://radar.oreilly.com/2013/06/radar-podcast-anthropology-big-data-and-the-importance-of-context.html

Anthropology, big data, and the importance of context

Jon Bruner, Jim Stogdill, and Roger Magoulas talk about what's been on their minds this week: the NSA's surveillance programs, what defense contractors will do with their technology as defense budgets dry up, and a Californian who isn't doing what you think he's doing with hydroponics.

For more on these topics, and links to the things we talked about, see http://radar.oreilly.com/2013/06/radar-podcast-the-internet-of-things-prism-and-defense-technology-that-goes-civilian.html.

The Internet of Things, PRISM, and defense technology that goes civilian

O'Reilly Media spreads the knowledge of innovators. At O’Reilly, a big part of our business is paying attention to what’s new and interesting in the world of technology. We have a pretty good record at having anticipated some of the big technology developments in recent history. For instance, we launched the first commercial Web site, GNN, in 1993; we organized the meeting at which the term “open source” was first adopted; we were early investors in Blogger, which helped launch the blogging revolution; and more recently, our Web 2.0 conference launched a world-wide meme. We call this predictive sense the “O’Reilly Radar.” And while we’re certainly not always right, we are, at least, good at making interesting guesses.

Our methodology is simple: we draw from the wisdom of the alpha geeks in our midst, paying attention to what’s interesting to them, amplifying these weak signals, and seeing where they fit into the innovation ecology. Add to that the original research conducted by our Research team, and you start to get a good picture of what the technology world is thinking about.