Scheduler Deep Dive
What Airflow's scheduler, executors, metadata DB, and concurrency knobs are actually doing. Every Airflow shop hits the same five performance walls. This course names them before you hit the third one.
What Airflow's scheduler, executors, metadata DB, and concurrency knobs are actually doing. Every Airflow shop hits the same five performance walls. This course names them before you hit the third one.
Course content
- 01What the Scheduler Actually Does on Each TickFree
- 02DAG Parsing: The Silent CPU Hog🔒
- 03Executor Showdown: Local, Celery, Kubernetes🔒
- 04The Metadata Database Is the Orchestrator🔒
- 05Pools, Priorities, and Slots: The Fairness Layer Nobody Configures🔒
- 06Queues and the Worker Fan-Out Problem🔒
- 07Concurrency Knobs: DAG, Task, Pool, Worker, and Which One Bit You🔒
- 08Sensors at Scale: The Silent Worker Drain🔒
- 09Tuning a Scheduler That's Already on Fire🔒
- 10The Orchestrator Market in One Lesson: Airflow vs Dagster vs Prefect vs Argo🔒
What to learn next
Read the first chapter free
Start reading now — no account required for the free chapters.