CoursesChallenges

Apache Kafka: Fundamentals

Topics, partitions, producers, consumers, delivery semantics, schemas, and Kafka Connect.

Learn how data moves at scale — topics, partitions, producers, consumers, delivery semantics, schemas, and Kafka Connect — by building real streaming pipelines for an e-commerce platform.

Foundations14 chapters· 4h 40m· in Ingestion & Transport

Course content

  1. 01Why Streaming? The Problem Kafka SolvesFree
  2. 02Kafka's Mental Model: Topics, Partitions, Offsets🔒
  3. 03Brokers, Clusters & Replication🔒
  4. 04Your First Producer🔒
  5. 05Your First Consumer & Consumer Groups🔒
  6. 06Keys, Partitioning & Ordering Guarantees🔒
  7. 07Delivery Semantics: At-Most-Once, At-Least-Once, Exactly-Once🔒
  8. 08Serialization: JSON, Avro & the Schema Registry🔒
  9. 09Retention, Compaction & Cleanup Policies🔒
  10. 10Kafka Connect: Moving Data In and Out Without Code🔒
  11. 11Operating Kafka Locally with Docker🔒
  12. 12Reading the Spark Kafka Source🔒
  13. 13Common Pitfalls: Hot Partitions, Rebalance Storms, Lag🔒
  14. 14Capstone: Build a Clickstream Pipeline for TheWorldShop🔒

What to learn next

↗Apache Kafka: Internals & Protocol Deep Dive· next

Read the first chapter free

Start reading now — no account required for the free chapters.

Start: Why Streaming? The Problem Kafka Solves →More in Ingestion & Transport