massOfai

Apache Airflow

Development & Tools

Workflow orchestration platform

What is Apache Airflow?

Schedule and monitor data pipelines as directed acyclic graphs (DAGs). Python-based.

Real-World Examples

  • Daily ETL jobs
  • ML pipeline orchestration
  • Data warehouse updates

When to Use This

For complex data workflows with dependencies

Related Terms

Learn more about concepts related to Apache Airflow