Apache Kafka: Event Streaming from Basics to Production

Learn Apache Kafka: topics, partitions, producers, consumer groups, delivery guarantees, retention, replication, exactly-once and operations, checked against a real broker.

Start course →

Syllabus

Kafka Basics

  1. What Kafka Is
  2. Topics, Partitions, Offsets and Records
  3. Brokers, Replication and KRaft
  4. Your First Topic: Create, Produce, Consume

Producers

  1. Keys and Partitioning
  2. Acknowledgements, Retries and Idempotence
  3. Batching and Compression
  4. Serialization and Schemas

Consumers and Consumer Groups

  1. Consumer Groups and Committed Offsets
  2. Assignment and Rebalancing
  3. Commits and Delivery Semantics
  4. Failures, Retries and Dead-Letter Topics

Designing Topics

  1. Choosing the Partition Count
  2. Retention and Log Compaction
  3. Naming, Ownership and Topic Hygiene

Durability and Reliability

  1. min.insync.replicas and Availability
  2. Failure Scenarios and Leader Election
  3. Idempotent Producers and Transactions

Streams, Connect and the Ecosystem

  1. Kafka Connect
  2. Stream Processing: Kafka Streams, Flink and ksqlDB

Operations and Security

  1. Monitoring What Matters
  2. Security: TLS, SASL and ACLs
  3. Capacity, Upgrades and Managed Services

Putting It Together

  1. Case Study: Order Events for an E-commerce Platform
  2. Revision: Cheat Sheet and Self-Check