MACHINE LEARNING

ml.platforms

The O'Reilly Data Show explores the opportunities and techniques driving big data and data science. Through interviews and analysis, we highlight the people putting data to work.

The O'Reilly Data Show Podcast

Top 50: Technology

A track from the official God of War: Ascension soundtrack.

God of War: Ascension - The Marked One

Not surprisingly, Joseph Sirosh, has big ambitions for his product portfolio at Microsoft which includes Azure ML, HDInsight and other tools. Chief among them is making it easy for mere mortals to consume these data services from the applications they're familiar with. Take Excel for example.

If a financial analyst can, with a few clicks, send data to a forecast service in the cloud, then get the numbers back, visualized on the same spreadsheet, that's a pretty powerful story, said Sirosh who is corporate VP of machine learning for Microsoft.

But as valuable as those applications and services are, more and more of the value to be derived from computation over time will be the data itself, not all those tech underpinnings.  "In the future a huge part of the value generated from computing will come from the data as opposed to storage and operating systems and basic infrastructure," he noted on this week's podcast. WHich is why one topic under discussion at next month's Structure Data show will be who owns all the data flowing betwixt and betweeen various systems, the internet of things etc.

When it comes to getting corporations running these new systems Microsoft may have an ace in the hole because so many of them already use key Microsoft tools -- Active Directory, SQL Server, Excel. That gives them a pretty good on-ramp to Microsoft Azure and its resident services. Sirosh makes a compelling case and we'll talk to him more on stage at Structure Data next month in New York City.

In the first half of the show, Derrick Harris and I talk about the Hadoop world has returned to its feisty and oh so interesting roots. When Pivotal announced its plan to offload support of Hadoop to Hortonworks and work with that company along with IBM, GE on  the Open Data Platform the response from Cloudera CEO Mike Olsen in a blog post with his take. 

Also on the docket, @WalmartLabs massive OpenStack production private cloud implementation.

Microsoft's machine learning guru on why data matters sooooo much

For promotional use only. (c) & (P) 2015 Sony Computer Entertainment Inc.

Buy Bloodborne

Bloodborne: Cleric Beast

Peter Gasston (https://twitter.com/stopsatgreen) is a front-end developer and web technologist that works for +rehabstudio (https://www.rehabstudio.com) in London.

Read the blog post about this interview: https://blog.feryn.eu/peter-gasston-commoditization-of-artificial-intelligence. The video is up on Youtube: https://youtu.be/_qremcORl9A

This interview was recorded in Rome at Codemotion 2016 (http://www.codemotionworld.com) where Peter presented his "OK Computer" presentation (https://speakerdeck.com/stopsatgreen/ok-computer-codemotion-rome) about the Commoditization of Artificial Intelligence.

We talk about how improved algorithms and the availability of massive computing power due to maturity of Cloud Computing has boosted Artificial Intelligence in a very profound way.

Both major players (Facebook, Google, Microsoft, IBM) and smaller startups can leverage the Cloud for machine learning and offer added value through easy-to-use customer-facing APIs.

Most implementations focus on natural language understanding and computer vision. Here's a list of tools, services and APIs that were mentioned in the interview and/or Peter's presentation.

https://wit.ai
https://cloud.google.com/vision/
http://www.ibm.com/smarterplanet/us/en/ibmwatson/what-is-watson.html
https://cognitoys.com
http://clarif.ai
https://www.metamind.io
http://www.skymind.io
https://www.projectoxford.ai

Thanks to machine learning and massive data processing, artificial intelligence is now a commodity: recognizing objects, locations and people on pictures. Or even understanding the meaning of a conversation. 

► Subscribe to my Youtube channel - http://youtube.com/ThijsFeryn
► Listen to the podcast on iTunes - http://itunes.feryn.eu
► Follow me on Twitter - http://twitter.com/ThijsFeryn
► Read my blog - http://blog.feryn.eu
► Check my presentations - http://talks.feryn.eu
► Thanks to Combell for sponsoring the show - http://www.combell.com

Peter Gasston - Commoditization of Artificial Intelligence

In this episode of the O’Reilly Data Show, I spoke with Mikio Braun, delivery lead and data scientist at Zalando. After spending previous years in academia, Braun recently made the decision to switch to industry. He shared some observations about building large-scale systems, particularly deploying data applications in production systems. Given his longstanding background as a machine learning researcher and practitioner, I wanted to get his take on topics like deep learning, hybrid systems, feature engineering, and AI applications.

Practical Machine Learning Techniques for Building Intelligent Applications

Fraud attacks have become much more sophisticated. Account takeovers are happening more often. Many security attacks involve multiple methods and unexpected attacks can devastate businesses in just a few days, as we saw with Neiman Marcus and Target. False promotion and abuse is seen not only on social media sites but is also targeted at business. To combat these risks, fraud solutions need to be smarter to keep pace with fraudsters to prevent attacks and react quickly when they do happen. This requires a fast-learning solution with the ability to continually evolve. In this episode we talk to Kevin Lee from Sift Science and examine the shifts in the info security landscape over the past ten or fifteen year. Lee also highlights what new kinds of fraud are now possible and what machine learning solutions are available. See more episodes at: www.TechEmergence.com &nbsp;

Machine Learning for Fraud Detection - Modern Applications and Risks

In this podcast, Deam Wampler discusses fast data, streaming, microservices, and the paradox of choice when it comes to the options available today building data pipelines.

Why listen to this podcast:

* Apache Beam is fast becoming the de-facto standard API for stream processing
* Spark is great for batch processing, but Flink is tackling the low-latency streaming processing market
* Avoid running blocking REST calls from within a stream processing system - have them asynchronously launched and communicate over Kafka queues
* Visibility into telemetry of streaming processing systems is still a new field and under active development
* Running the fast data platform is easily launched on an existing or new Mesosphere DC/OS runtime

More on this: Quick scan our curated show notes on InfoQ http://bit.ly/2BYTMbI

You can also subscribe to the InfoQ newsletter to receive weekly updates on the hottest topics from professional software development. bit.ly/24x3IVq

Subscribe: www.youtube.com/infoq
Like InfoQ on Facebook: bit.ly/2jmlyG8
Follow on Twitter: twitter.com/InfoQ
Follow on LinkedIn: www.linkedin.com/company/infoq
Want to see extented shownotes? Check the landing page on InfoQ: http://bit.ly/2BYTMbI

InfoQ Podcast

Show Notes

Fast Data with Dean Wampler

This week, AI in Industry features Jeremy Barnes, Chief Architect at Element AI. Jeremy talks about the common mistakes some businesses might make while adopting AI to solve broad business problems. He also sheds light on the problem areas that could raise the market value of businesses through AI adoption, hiring the right talent with the right combination of subject matter expertise and business experience, and the business and technical aspects executives should consider before contemplating the adoption of AI. For more insights on the B2B applications of AI, go to techemergence.com

Avoiding Common Mistakes in Applying AI to Business Problems - with Jeremy Barnes of Element AI

Sales forecasting is big business. If you can better predict how much of a certain product or service you will sell in a given day, you can better stock inventory, better staff your facilities, and ultimately keep more margin in your business's accounts. This week on AI in Industry we interview Dr. John-Paul B Clarke, professor at Georgia Tech and co-founder / Chief Scientist at Pace (previously called "Prix"). Dr. Clarke shares details about how sales predictions are done today, and what AI advancements may allow for in helping businesses sell everything from groceries to hotel rooms. Read the full interview article online at:&nbsp; techemergence.com/ai-sales-forecasting-works-matters

AI for Sales Forecasting - How it Works and Where it Matters

In this episode of the Data Show, I spoke with Ashok Srivastava, senior vice president and chief data officer at Intuit. He has a strong science and engineering background, combined with years of applying machine learning and data science in industry. Prior to joining Intuit, he led the teams responsible for data and artificial intelligence products at Verizon. I wanted his perspective on a range of issues, including the role of the chief data officer, ethics in machine learning, and the emergence of AI technologies for enterprise products and applications.

The Real Value of Data Requires a Holistic View of the End- to-End Data Pipeline

Mission Impossible-Fallout

In this episode of the Data Show, I spoke with Harish Doddi, co-founder and CEO of Datatron, a startup focused on helping companies deploy and manage machine learning models. As companies move from machine learning prototypes to products and services, tools and best practices for productionizing and managing models are just starting to emerge. Today’s data science and data engineering teams work with a variety of machine learning libraries, data ingestion, and data storage technologies. Risk and compliance considerations mean that the ability to reproduce machine learning workflows is essential to meet audits in certain application domains. And as data science and data engineering teams continue to expand, tools need to enable and facilitate collaboration.

As someone who specializes in helping teams turn machine learning prototypes into production-ready services, I wanted to hear what Doddi has learned while working with organizations that aspire to “become machine learning companies.”

Simplifying Machine Learning Lifecycle Management

In this episode of the Data Show, I spoke with Eric Jonas, a postdoc in the new Berkeley Center for Computational Imaging. Jonas is also affiliated with UC Berkeley’s RISE Lab. It was at a RISE Lab event that he first announced Pywren, a framework that lets data enthusiasts proficient with Python run existing code at massive scale on Amazon Web Services. Jonas and his collaborators are working on a related project, NumPyWren, a system for linear algebra built on a serverless architecture. Their hope is that by lowering the barrier to large-scale (scientific) computation, we will see many more experiments and research projects from communities that have been unable to easily marshal massive compute resources. We talked about Bayesian machine learning, scientific computation, reinforcement learning, and his stint as an entrepreneur in the enterprise software space.

Building Accessible Tools for Large-Scale Computation and Machine Learning

In this episode of the Data Show, I spoke with Vitaly Gordon, VP of data science and engineering at Salesforce. As the use of machine learning becomes more widespread, we need tools that will allow data scientists to scale so they can tackle many more problems and help many more people. We need automation tools for the many stages involved in data science, including data preparation, feature engineering, model selection and hyperparameter tuning, as well as monitoring.

I wanted the perspective of someone who is already faced with having to support many models in production. The proliferation of models is still a theoretical consideration for many data science teams, but Gordon and his colleagues at Salesforce already support hundreds of thousands of customers who need custom models built on custom data. They recently took their learnings public and open sourced TransmogrifAI, a library for automated machine learning for structured data, which sits on top of Apache Spark.

Building Tools for Enterprise Data Science

In this episode of the Data Show, I spoke with Roger Chen, co-founder and CEO of Computable Labs, a startup focused on building tools for the creation of data networks and data exchanges. Chen has also served as co-chair of O'Reilly's Artificial Intelligence Conference since its inception in 2016. This conversation took place the day after Chen and his collaborators released an interesting new white paper, "Fair value and decentralized governance of data." Current-generation AI and machine learning technologies rely on large amounts of data, and to the extent they can use their large user bases to create “data silos,” large companies in large countries (like the U.S. and China) enjoy a competitive advantage. With that said, we are awash in articles about the dangers posed by these data silos. Privacy and security, disinformation, bias, and a lack of transparency and control are just some of the issues that have plagued the perceived owners of “data monopolies.”

Acquiring and Sharing High-Quality Data

In this episode of the Data Show, I speak with Cassie Kozyrkov, technical director and chief decision scientist at Google Cloud. She describes "decision intelligence" as an interdisciplinary field concerned with all aspects of decision-making, and which combines data science with the behavioral sciences. Most recently she has been focused on developing best practices that can help practitioners make safe, effective use of AI and data. Kozyrkov uses her platform to help data scientists develop skills that will enable them to connect data and AI with their organizations' core businesses.

We had a great conversation spanning many topics, including:

How data science can be more useful

The importance of the human side of data

The leadership talent shortage in data science

Is data science a bubble?

Make Data Science More Useful

In this episode of the Data Show, I speak with Alex Ratner, project lead for Stanford’s Snorkel open source project; Ratner also recently garnered a faculty position at the University of Washington and is currently working on a company supporting and extending the Snorkel project. Snorkel is a framework for building and managing training data. Based on our survey from earlier this year, labeled data remains a key bottleneck for organizations building machine learning applications and services.

Ratner was a guest on the podcast a little over two years ago when Snorkel was a relatively new project. Since then, Snorkel has added more features, expanded into computer vision use cases, and now boasts many users, including Google, Intel, IBM, and other organizations. Along with his thesis advisor professor Chris Ré of Stanford, Ratner and his collaborators have long championed the importance of building tools aimed squarely at helping teams build and manage training data. With today’s release of Snorkel version 0.9, we are a step closer to having a framework that enables the programmatic creation of training data sets.

Labeling, Transforming, and Structuring Training Data Sets for Machine Learning

In this episode of the Data Show, I speak with Kesha Williams, technical instructor at A Cloud Guru, a training company focused on cloud computing. As a full stack web developer, Williams became intrigued by machine learning and started teaching herself the ML tools on Amazon Web Services. Fast forward to today, Williams has built some well-regarded Alexa skills, mastered ML services on AWS, and has now firmly added machine learning to her developer toolkit.

Becoming a Machine Learning Practitioner

In this episode of the Data Show, I speak with Michael Mahoney, a member of RISELab, the International Computer Science Institute, and the Department of Statistics at UC Berkeley. A physicist by training, Mahoney has been at the forefront of many important problems in large-scale data analysis. On the theoretical side, his works spans algorithmic and statistical methods for matrices, graphs, regression, optimization, and related problems. On the applications side, he has contributed to systems used for internet and social media analysis, social network analysis, as well as for a host of applications in the physical and life sciences. Most recently, he has been working on deep neural networks, specifically developing theoretical methods and practical diagnostic tools that should be helpful to practitioners who use deep learning.

Understanding Deep Neural Networks

O'Reilly Media spreads the knowledge of innovators. At O’Reilly, a big part of our business is paying attention to what’s new and interesting in the world of technology. We have a pretty good record at having anticipated some of the big technology developments in recent history. For instance, we launched the first commercial Web site, GNN, in 1993; we organized the meeting at which the term “open source” was first adopted; we were early investors in Blogger, which helped launch the blogging revolution; and more recently, our Web 2.0 conference launched a world-wide meme. We call this predictive sense the “O’Reilly Radar.” And while we’re certainly not always right, we are, at least, good at making interesting guesses.

Our methodology is simple: we draw from the wisdom of the alpha geeks in our midst, paying attention to what’s interesting to them, amplifying these weak signals, and seeing where they fit into the innovation ecology. Add to that the original research conducted by our Research team, and you start to get a good picture of what the technology world is thinking about.

Building Accessible Tools for Large-Scale Computation and Machine Learning

O'Reilly Radar