data

data stuff

todo

O'Reilly Radar tracks the technologies and people that will shape our world in the years to come. Each episode of O'Reilly Radar features an interview with an industry thought leader, with topics touching on everything from programming to data to experience design. We also take a step back from the breathless pace of the latest tech news to examine why new developments are important and what they might mean down the road.

O'Reilly Radar Podcast

O'REILLY

podcast

Data Science

In this episode, Ben Lorica chats with Jay Kreps, a highly regarded data engineer and former technical lead for Online Data Infrastructure at LinkedIn, and most recently CEO/co-founder of Confluent, about Apache Kafka, data integration, event data, and the Internet of Things.

Building Apache Kafka From Scratch

O’Reilly’s Ben Lorica chats with Kira Radinsky, CTO and co-founder of SalesPredict, about predicting events using machine learning, NLP, and semantic analysis.

Forecasting events, from disease outbreaks to sales to cancer research

O'Reilly's Jenn Webb chats with Stewart Collis about our current global agriculture situation, the impact of big data on agriculture, and the work his company is doing to help address global agriculture problems. Also, we have a special feature: 3 Questions with Scott Donaldson, senior director at FINRA.

Big Data's Impact on Global Agriculture

O'Reilly's Ben Lorica chats with Michael Stack to get an update on the Apache HBase project.

Coming Full Circle With Bigtable and HBase

"Machine learning is to big data as human learning is to life experience," says Christopher Nguyen, the co-founder and CEO of big data intelligence company Adatao. Sure, but then, what IS big data? (especially as it's become a buzzword that captures so many things)... 

On this episode of the a16z Podcast, Nguyen puts on his former computer science professor hat to describe 'big data' in relation to 'machine learning' -- as well as what comes next with 'deep learning'. Finally, the former Google exec shares how Hadoop and Spark evolved from the efforts of companies dealing with massive amounts of real-time information; what we need to make machine learning a property of every application (why would we even want to?); and how we can make all this intelligence accessible to everyone.

–––

The views expressed here are those of the individual AH Capital Management, L.L.C. (“a16z”) personnel quoted and are not the views of a16z or its affiliates. Certain information contained in here has been obtained from third-party sources, including from portfolio companies of funds managed by a16z. While taken from sources believed to be reliable, a16z has not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation.
 
This content is provided for informational purposes only, and should not be relied upon as legal, business, investment, or tax advice. You should consult your own advisers as to those matters. References to any securities or digital assets are for illustrative purposes only, and do not constitute an investment recommendation or offer to provide investment advisory services. Furthermore, this content is not directed at nor intended for use by any investors or prospective investors, and may not under any circumstances be relied upon when making a decision to invest in any fund managed by a16z. (An offering to invest in an a16z fund will be made only by the private placement memorandum, subscription agreement, and other relevant documentation of any such fund and should be read in their entirety.) Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z, and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by Andreessen Horowitz (excluding investments and certain publicly traded cryptocurrencies/ digital assets for which the issuer has not provided permission for a16z to disclose publicly) is available at https://a16z.com/investments/.

Charts and graphs provided within are for informational purposes solely and should not be relied upon when making any investment decision. Past performance is not indicative of future results. The content speaks only as of the date indicated. Any projections, estimates, forecasts, targets, prospects, and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Please see https://a16z.com/disclosures for additional important information.

a16z Podcast: Making Sense of Big Data, Machine Learning, and Deep Learning

O'Reilly's Ben Lorica chats with Anima Anandkumar about tensor decomposition techniques for machine learning.

The Tensor Renaissance In Data Science

In the last episode, we zipped through neural nets and got a quick idea of how they work and why they can be so powerful. Here’s the real payoff of that work:

In this episode, we’ll talk about a brand-new pair of results, one from Stanford and one from Google, that use neural nets to perform automated picture captioning. One neural net does the object and relationship recognition of the image, a second neural net handles the natural language processing required to express that in an English sentence, and when you put them together you get an automated captioning tool. Two heads are better than one indeed...

Neural Nets (Part 2)

Let’s talk money. As a “hot” career right now, data science can pay pretty well. But for an individual person matched with a specific job or industry, how much should someone expect to make? 

Since Katie was on the job market lately, this was something she’s been researching, and it turns out that data science itself (in particular linear regressions) has some answers. 

In this episode, we go through a survey of hundreds of data scientists, who report on their job duties, industry, skills, education, location, etc. along with their salaries, and then talk about how this data was fed into a linear regression so that you (yes, you!) can use the patterns in the data to know what kind of salary any particular kind of data scientist might expect.

Careers in Data Science

O'Reilly's Ben Lorica chats with Gary Kazantsev, who runs the R&D Machine Learning group at Bloomberg LP, about how big data and data science are making a difference in finance.

Data Science Makes an Impact on Wall Street

O'Reilly's Jenn Webb chats with Cait O’Riordan, VP of product, music and platforms at Shazam, about the current state of predictive analytics and how Shazam is able to predict the success of a song, and how the Internet of Things affects Shazam’s product life cycles as well as the behaviors of their users. Jenn also chats with Francine Bennett, CEO and cofounder of Mastodon C, about unintentional uses of data for evil and how data scientists can ensure their work stays on the data for good side of that line.

How Shazam Predicts Pop Hits

Marcus Schössow is back on his own imprint Code Red with 'Smile'. A happy disco influenced house track that once again proves the label stands for groovy house music. "I want our releases to have a good vibe and sexy feel", Schössow explains. 

With 'Smile', Code Red's founder shows again he isn't afraid to explore different genres and sounds. Schössow says Code Red has to become a community rather than just the next record label by a dj. "We are all our own A&R's, so why limit our taste and creativity?" 

Code Red's second release goes the name 'Smile' because it actually makes people smile. Not only because Schössow says so, but also according all the positive reactions online. A smile Marcus will bring to the USA and Asia during his Code Red tour this summer.

www.facebook.com/marcusschossow
twitter.com/marcusschossow
@marcusschossow

www.facebook.com/coderedworld
twitter.com/coderedworld
@coderedworld

Smile

Download

Marcus Schossow - Smile // OUT NOW

O'Reilly's Mike Hendrickson chats with database pioneer and 2014 Turing Award recipient Michael Stonebraker about winning the award, the future of data science, and the importance — and difficulty — of data curation.

The Future of Data at Scale

In episode twenty two we talk with Adam Kalai of Microsoft Research New England about his work using crowdsourcing in Machine Learning, the language made of shapes of words, and New England Machine Learning Day. We take a look at the workshops being presented at NIPS this year, and we take a listener question about changing the number of features your data has.

Workshops At NIPS And Crowdsourcing In Machine Learning

In this special holiday episode of the O’Reilly Data Show, I look back at two conversations I had earlier this year at the Spark Summit in San Francisco. The first segment is an on-stage fireside chat with Ben Horowitz, co-founder of Andreessen Horowitz and author of The Hard Thing About Hard Things.

In the second segment, Reynold Xin, one of the architects of Apache Spark, explains the rise of Apache Spark in China.

Investing in Big Data Technologies

In this O’Reilly Podcast, Ben Lorica talks with John Hugg, founding engineer and manager of developer outreach at VoltDB. From the deluge of today's diverse data, Hugg describes how to extract meaningful information to make things cheaper and faster.

Streaming data + stream processing = information

This week, I sit down with anthropologist, futurist, Intel Fellow, and director of interaction and experience research at Intel, Genevieve Bell. We talk about what she’s learning from current AI research, why the resurgence of AI is different this time, and five things that are missing from the AI conversation.

Genevieve Bell on Moving From Human-Computer Interactions to Human-Computer Relationships

This week, I sit down with Tom Davenport. Davenport is a professor of Information Technology and Management at Babson College, the co-founder of the International Institute for Analytics, a fellow at the MIT Center for Digital Business, and a senior advisor for Deloitte Analytics. He also pioneered the concept of “competing on analytics.” We talk about how his ideas have evolved since writing the seminal work on that topic, Competing on Analytics: The New Science of Winning; his new book Only Humans Need Apply: Winners and Losers in the Age of Smart Machines, which looks at how AI is impacting businesses; and we talk more broadly about how AI is impacting society and what we need to do to keep ourselves on a utopian path.

Tom Davenport on Mitigating AI's Impact on Jobs and Business

In this week's Radar Podcast, O’Reilly’s Mac Slocum chats with Sara Watson, a technology critic and writer in residence at Digital Asia Hub. Watson is also a research fellow at the Tow Center for Digital Journalism at Columbia and an affiliate with the Berkman Klein Center for Internet and Society at Harvard. They talk about how to optimize personalized experience for consumers, the role of machine learning in this space, and what will drive the evolution of personalized experiences.

Sara Watson on Optimizing Personalized Experiences

This week, I sit down with David Beyer, an investor with Amplify Partners. We talk about machine learning and artificial intelligence, the challenges he’s seeing in AI adoption, and what he thinks is missing from the AI conversation.

AI Adoption at the Atomic Level of Jobs and Work

This week, I sit down with Aman Naimat, senior vice president of technology at Demandbase, and co-founder and CTO of Spiderbook. We talk about his project to build a knowledge graph of the entire business world using natural language processing and deep learning. We also talk about the role AI is playing in those companies today and what’s going to drive AI adoption in the future.

Aman Naimat on Building a Knowlege Graph of the Entire Business World

Jon Bruner and Mike Loukides talk about the classical music publishing industry and how it's being disrupted by projects like the Petrucci Music Library (http://imslp.org/) that make public-domain scores available online.

The future of classical music

Jim Stogdill, Edd Dumbill and Roger Magoulas have a conversation about in-memory databases and the impact on real time analysis. Leave questions and comments for us at http://radar.oreilly.com/2013/05/talking-about-in-memory.html

Talking about in-memory

Jon Bruner, Mike Loukides and Jim Stogdill from O'Reilly Radar muse on the return of software to the physical world.

Software and the physical world

Jon Bruner, Jim Stogdill, and Roger Magoulas talk about anthropology in big data, advances in JavaScript, searching for ancient civilizations, the importance of context, and good sites for checking the weather.

Related blog post: http://radar.oreilly.com/2013/06/radar-podcast-anthropology-big-data-and-the-importance-of-context.html

Anthropology, big data, and the importance of context

Jon Bruner, Jim Stogdill, and Roger Magoulas talk about what's been on their minds this week: the NSA's surveillance programs, what defense contractors will do with their technology as defense budgets dry up, and a Californian who isn't doing what you think he's doing with hydroponics.

For more on these topics, and links to the things we talked about, see http://radar.oreilly.com/2013/06/radar-podcast-the-internet-of-things-prism-and-defense-technology-that-goes-civilian.html.

The Internet of Things, PRISM, and defense technology that goes civilian

O'Reilly Media spreads the knowledge of innovators. At O’Reilly, a big part of our business is paying attention to what’s new and interesting in the world of technology. We have a pretty good record at having anticipated some of the big technology developments in recent history. For instance, we launched the first commercial Web site, GNN, in 1993; we organized the meeting at which the term “open source” was first adopted; we were early investors in Blogger, which helped launch the blogging revolution; and more recently, our Web 2.0 conference launched a world-wide meme. We call this predictive sense the “O’Reilly Radar.” And while we’re certainly not always right, we are, at least, good at making interesting guesses.

Our methodology is simple: we draw from the wisdom of the alpha geeks in our midst, paying attention to what’s interesting to them, amplifying these weak signals, and seeing where they fit into the innovation ecology. Add to that the original research conducted by our Research team, and you start to get a good picture of what the technology world is thinking about.