Data engineering educator Andreas Kretz joins Jon Krohn for a 1-hour primer that covers everything you need to know about the most in-demand role in data. From skills to tools, problem-solving processes and more, growing your knowledge of data engineering only improves your marketability, so tune in today if you're ready to future-proof your data career.

This episode is brought to you by Glean (https://glean.io), the platform for data insights fast, and by epic LinkedIn Learning instructor Keith McCormick (https://linkedin.com/learning/instructors/keith-mccormick). Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.

In this episode you will learn:
• Why learn data engineering? [06:55]
• What is data engineering? [08:08]
• What sets Senior Data Engineers apart from junior ones? [13:57]
• The must-know data-engineering tools [20:26]
• The right path to learn data engineering [44:24]
• Are certifications worth it? [51:46]
• The future of data engineering [55:24]
• Andreas's career challenges [58:48]

Additional materials: www.superdatascience.com/657

The Super Data Science Podcast: Machine Learning | AI | Success

657: How to Learn Data Engineering

Ready to Build and Lead a Successful Data Team? 📈

Check out our latest podcast episode on Building and Leading Successful Data Teams, where we discuss overcoming challenges, building a data culture, prioritizing data initiatives, fostering collaboration, and staying ahead in the data field. 

Today's host is Pearlie Leng (Associate Consultant at Evolution), specializing in data! Joining her today is Samuel Chu (Head of Data Science and Analytics at Singlife Aviva)!

Don't miss out on this informative and insightful conversation! 

Click below to watch it NOW! 

#data #datateams #leadership

Evo SG #31 - Building And Leading Successful Data Teams

Angel investor and data science consultant Josh Wills sits down with Jon Krohn to discuss his former roles (Google, Slack, and Cloudera) and the essential skills for engineering scalable machine learning projects.

This episode is brought to you by Pathway, the reactive data processing framework (www.pathway.com/?from=superdatascience), and by epic LinkedIn Learning instructor Keith McCormick(https://linkedin.com/learning/instructors/keith-mccormick). Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.

In this episode you will learn:
• Josh's 'Data Engineering for Machine Learning' course [06:50]
• Contextual bandits [10:52]
• Data quality and monitoring [16:45]
• The “infinite loop of sadness” in data product development [25:12]
• Josh’s definition of a data scientist [30:02]
• Josh's role at WeaveGrid [37:36]
• Management-Track vs Independent Contributor [48:47]
• Josh's work on the Covid pandemic [1:06:46] 
• Josh’s favorite tech stack [1:11:13]

Additional materials: www.superdatascience.com/665

665: How to be both socially impactful and financially successful in your data career

❗Our new podcast episode titled, “How Data Drives Business & Decision Making Within a Large Organisation” is up and running❗

Join us as we discuss:

- How data has transformed decision-making within large organizations? 🤔
- The challenges faced when implementing data-driven decision making, and how to overcome them
- Some of the emerging trends and technologies that will shape the future of data-driven decision making 💭
- AND MORE!

Our host for this episode is Pearlie Leng (Associate Consultant at Evolution), and joining her is:

❇️ Amit Jain - Head of Data Analytics & Business Intelligence (Group Digital Office) and Lead of Digital Centre of Excellence at Keppel Corp

Check it out NOW! 👇

#data #decisionmaking #dataanalytics

Evo SG #50 - How Data Drives Business & Decision Making

This is episode 279 recorded on July 11th, 2024 where John & Jason talk about the Microsoft Fabric, including Power BI, June 2024 Feature Summary including a Visual Calcs update, updates to downloading large semantic models, the new PBIR file format, and external sharing API for OneLake, a Spark Connector for Fabric Datawarehouse, and much more.

Episode 279 - Power BI & Fabric June 2024 Feature Summary

In this episode of the podcast, members of the InfoQ editorial staff and friends of InfoQ will be discussing the current trends in the domain of AI, ML and Data Engineering.

One of the regular features of InfoQ are the trends reports, which each focus on a different aspect of software development. These reports provide the InfoQ readers and listeners with a high-level overview of the topics to pay attention to this year.

InfoQ AI, ML and Data Engineering editorial team met with external guests to discuss the trends in AI and ML areas, and what to watch out for the next 12 months. This podcast is a recording of this discussion where panelists discuss how the innovative AI technologies are disrupting the industry.

Read a transcript of this podcast panel: https://bit.ly/3LXMcUk 
Find the written report and trends graph on InfoQ: https://bit.ly/3Z8Z5CF 

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:
www.infoq.com/software-architects-newsletter

Upcoming Events:

InfoQ Dev Summit Munich (Sept 26-27, 2024)
Practical learnings from senior software practitioners navigating Generative AI, security, modern web applications, and more.
devsummit.infoq.com/conference/munich2024

QCon San Francisco (November 18-22, 2024)
Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.
qconsf.com/

QCon London (April 7-9, 2025)
Discover new ideas and insights from senior practitioners driving change and innovation in software development.
qconlondon.com/

The InfoQ Podcasts:
Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast www.infoq.com/podcasts/
- Engineering Culture Podcast by InfoQ www.infoq.com/podcasts/#engineering_culture
- Generally AI

Follow InfoQ:
- Mastodon: techhub.social/@infoq
- Twitter: twitter.com/InfoQ
- LinkedIn: www.linkedin.com/company/infoq
- Facebook: bit.ly/2jmlyG8
- Instagram: @infoqdotcom
- Youtube: www.youtube.com/infoq

Write for InfoQ:
Learn and share the changes and innovations in professional software development.
- Join a community of experts.
- Increase your visibility.
- Grow your career.
www.infoq.com/write-for-infoq

Transcript

AI, ML, and Data Engineering Trends in 2024

In this podcast, we explore the transformative power of data visualization and how it can help businesses make better decisions. Learn how Impressico Business Solutions’ data visualization services provide tailored, interactive dashboards that turn complex data into actionable insights, driving business growth and efficiency. https://www.impressico.com/services/offerings/data-analytics-bi/

Unlocking the Power of Data Visualization Services

This is episode 292 recorded on April 22nd, 2025 where John & Jason talk the Microsoft Fabric February 2025 Feature Summary including Fabric Platform, OneLake, and Data Engineering.

Episode 292 - Microsoft Fabric March 2025 Feature Summary

This is episode 298 recorded on July 9th, 2025, where John & Jason talk the Microsoft Fabric June 2025 Feature Summary including lots of Notebook updates in Data Engineering, lower cost for AI functions in Data Science, Copilot for RTI dashboards, and more.

For show notes please visit www.bifocal.show

Episode 298 - Microsoft Fabric June 2025 Feature Summary

Bringing together leaders in the technology space to discuss the challenges they're facing and the solutions they're delivering.

Hey, I'm Catherine William Experienced web developer with a strong background in developing applications for diverse clients. I have 5+ years of industry experience in programming, debugging, and wireframes. Now I'm working with Impressico Business Solution. They are offering front-end and UI UX development services and many more. Visit our website to know more about our services.

Software engineers, architects and team leads have found inspiration to drive change and innovation in their team by listening to the weekly InfoQ Podcast. They have received essential information that helped them validate their software development map. We have achieved that by interviewing some of the top CTOs, engineers and technology directors from companies like Uber, Netflix and more. Over 1,200,000 downloads in the last 3 years.

The latest machine learning, A.I., and data career topics from across both academia and industry are brought to you by host Dr. Jon Krohn on the Super Data Science Podcast.

As the quantity of data on our planet doubles every couple of years and with this trend set to continue for decades to come, there's an unprecedented opportunity for you to make a meaningful impact in your lifetime. In conversation with the biggest names in the data science industry, Jon cuts through hype to fuel that professional impact.

Whether you're curious about getting started in a data career or you're a deep technical expert, whether you'd like to understand what A.I. is or you'd like to integrate more data-driven processes into your business, we have inspiring guests and lighthearted conversation for you to enjoy.

We cover tools, techniques, and implementation tricks across data collection, databases, analytics, predictive modeling, visualization, software engineering, real-world applications, commercialization, and entrepreneurship − everything you need to crush it with data science.

New tracks tagged #Data Engineering