Eckerson Group Audio Blogs

pipelines

Every organization that manufactures data for decision making is rethinking its data architecture. Compared to five years ago, there is a treasure trove of new technologies and techniques that promise to transform the way organizations compete and serve customers. This audio blog summarizes the major characteristics of a modern data architecture and serves a high-level guide for organizations that are in the midst of developing a new data strategy for the modern age.

Originally published at https://www.eckerson.com/articles/ten-characteristics-of-a-modern-data-architecture

Ten Characteristics Of A Modern Data Architecture by Wayne Eckerson - Audio Blog

Data engineering is one of the hottest and most difficult jobs to fill in the field of analytics. Breadth and depth of required skills limits the number of people qualified to work as data engineers. If you’re seeking to hire data engineers, consider the 24 skill areas identified here as guidance to shape job descriptions and to screen candidates. If you’re seeking to become a data engineer, take the skills assessment to highlight your strengths and identify your gaps.

Originally published at https://www.eckerson.com/articles/data-engineering-coming-of-age

Data Engineering Coming of Age by Dave Wells - Audio Blog

To survive and thrive in today’s information economy, organizations need to establish a compelling data strategy that advances the company’s key objectives and goals. This is not a job for the chief information officer or even chief data officer; it’s a task that the CEO must own and champion and assemble his best and brightest to execute. This audio blog examines the ten step methodology that Eckerson Group uses to help organizations create a data strategy.

Originally published at https://www.eckerson.com/articles/how-to-create-a-data-strategy-part-1-overview

Ten Steps To Create A Data Strategy by Wayne Eckerson - Audio Blog

Ethics is challenging because right and good are not always clear. More data, more kinds of data, and advanced analysis of data often conflict with concerns of data privacy, security, anonymity, and ownership. Resolving these conflicts requires acknowledgment, discussion, and the hard work of defining ethics-based policies and creating a culture of ethical conduct.

Originally published at https://www.eckerson.com/articles/data-ethics-the-new-data-governance-challenge

Data Ethics - The New Data Governance Challenge by Dave Wells - Audio Blog

With today’s unprecedented velocity of change in data and technologies, the single version of the truth (SVOT) is sometimes looked upon as a nice to have. But SVOT is not optional. Despite the difficulties in constructing a single version of the truth, it is now needed more than ever to keep CEOs happy and to stay compliant with new regulations like the GDPR.

Originally published at https://www.eckerson.com/articles/single-version-of-the-truth-not-optional

Single Version of the Truth - Not Optional by Stephen J. Smith - Audio Blog

In this episode, we dove into the relationship between Airflow and Kuberenetes and interviewed Daniel Imberman, Senior Software Engineer at Bloomberg (1:30), and Greg Neiheisel, CTO here at Astronomer (37:31). Daniel has done most of the work on the Kubernetes executor for Airflow and Greg plans to take on a chunk of the development going forward, so it was really interesting to hear both of their perspectives on the project. Enjoy!

Airflow on Kubernetes

Data pipelines become chaotic with pressures of agile, democratization, self-service, and organizational “pockets” of analytics. From enterprise BI to self-service analysis, data pipeline management should ensure analysis results are traceable, reproducible, and of production strength. Robust data pipelines rely on eight critical components.

Originally published at https://www.eckerson.com/articles/the-complexities-of-modern-data-pipelines

The Complexities Of Modern Data Pipelines by Dave Wells - Audio Blog

Listen to data and analytics leaders share the secrets of their success. Wayne Eckerson, long-time global thought leader interviews guests who run data and analytics programs at Fortune 2000 organizations around the world. Tune in to stay abreast of the latest technologies, techniques, and trends in our fast-paced industry.

The Complexities Of Modern Data Pipelines by Dave Wells - Audio Blog

Secrets of Data & Analytics Leaders