Cianplan

Level 2: Data · L2.8 Batch, streaming & change data capture

The log: Kafka's mental model

Explain topics, partitions, offsets and consumer groups.

13 min · Pro

What you take away

  • A topic is an append-only log split into partitions; each record has an offset within its partition.

And 3 more inside the class, in Pro.

How the class is laid out

  1. The problem
  2. The simple version
  3. The shape
  4. Check your understanding