Cianplan

Level 2: Data · L2.8 Batch, streaming & change data capture

Ordering, partition keys and consumer scaling

Choose partition keys that keep needed order and allow parallelism.

12 min · Pro

What you take away

  • Order exists only within a partition, so the partition key must be the entity whose order matters.

And 3 more inside the class, in Pro.

How the class is laid out

  1. The problem
  2. The simple version
  3. Ordering against parallelism
  4. What changing the partition count does
  5. Check your understanding