Cianplan

Level 4: Reliability, security & cloud · L4.3 Fault tolerance, disaster recovery & multi-region

Cascading failures and chaos engineering

Explain cascading failures and how chaos experiments find them.

12 min · Pro

What you take away

  • A cascading failure is a positive feedback loop: lost capacity raises load on the survivors, which lose capacity in turn.

And 3 more inside the class, in Pro.

How the class is laid out

  1. The problem
  2. A loop, not a chain
  3. Getting out, and staying out
  4. Chaos engineering: an experiment, not a hammer
  5. Failure domains
  6. RTO and RPO
  7. Multi-region
  8. Cells and shuffle sharding
  9. Cascades and chaos
  10. Check your understanding