Apache Kafka: Internals & Protocol Deep Dive
Broker internals, replication, ISR, controller, log layout, and the Kafka wire protocol.
Open the hood on Kafka: log segments, replication protocol, ISR, controller, KRaft, consumer rebalance, idempotent producers, transactions, log compaction, tiered storage, and share groups, so you can debug, tune, and operate Kafka at production depth.
Course content
- 01The Commit Log: Why Kafka's Storage Is the Whole IdeaFree
- 02Log Segments, Indexes & Page Cache🔒
- 03Producers Under the Hood: Batching, Linger, Compression🔒
- 04The Replication Protocol & In-Sync Replicas (ISR)🔒
- 05Leader Election & The Controller (ZooKeeper → KRaft)🔒
- 06Consumer Group Protocol & Rebalance (Eager vs Cooperative)🔒
- 07Offset Management & __consumer_offsets🔒
- 08Idempotent Producers🔒
- 09Transactions & Exactly-Once Semantics (EoS)🔒
- 10Log Compaction Deep Dive🔒
- 11Tiered Storage🔒
- 12Share Groups and Queue Semantics (KIP-932)🔒
- 13Quotas, Throttling & Multi-Tenancy Internals🔒
- 14Reading the Wire Protocol (request/response, fetch sessions)🔒
- 15Capstone: Diagnose a Real Production Incident from Metrics🔒
Prerequisites
Read the first chapter free
Start reading now — no account required for the free chapters.