Apache Kafka: Internals & Protocol Deep Dive
Broker internals, replication, ISR, controller, log layout, and the Kafka wire protocol.
Open the hood on Kafka — log segments, replication protocol, ISR, controller, KRaft, consumer rebalance, idempotent producers, transactions, log compaction, and tiered storage — so you can debug, tune, and operate Kafka at production depth.
Course content
- 01The Commit Log: Why Kafka's Storage Is the Whole IdeaFree
- 02Log Segments, Indexes & Page Cache🔒
- 03Producers Under the Hood: Batching, Linger, Compression🔒
- 04The Replication Protocol & In-Sync Replicas (ISR)🔒
- 05Leader Election & The Controller (ZooKeeper → KRaft)🔒
- 06Consumer Group Protocol & Rebalance (Eager vs Cooperative)🔒
- 07Offset Management & __consumer_offsets🔒
- 08Idempotent Producers🔒
- 09Transactions & Exactly-Once Semantics (EoS)🔒
- 10Log Compaction Deep Dive🔒
- 11Tiered Storage🔒
- 12Quotas, Throttling & Multi-Tenancy Internals🔒
- 13Reading the Wire Protocol (request/response, fetch sessions)🔒
- 14Capstone: Diagnose a Real Production Incident from Metrics🔒
Prerequisites
Read the first chapter free
Start reading now — no account required for the free chapters.