Cross-DAG Dependencies in Apache Airflow: A Comprehensive Guide
Jul 4, 2023
•
Frederic Vanderveken
Exploring four methods to effectively manage and scale your data workflow dependencies with Apache Airflow.
Latest
From Good AI to Good Data Engineering. Or how Responsible AI interplays with High Data Quality
Responsible AI depends on high-quality data engineering to ensure ethical, fair, and transparent AI systems.
A glimpse into the life of a data leader
Data leaders face pressure to balance AI hype with data landscape organization. Here’s how they stay focused, pragmatic, and strategic.
Data Stability with Python: How to Catch Even the Smallest Changes
As a data engineer, it is nearly always the safest option to run data pipelines every X minutes. This allows you to sleep well at night…