Cianplan

Level 2: Data · L2.7 Search & blob/object storage

Search clusters and keeping the index fresh

Shard a search index and sync it from the primary database.

12 min · Pro

What you take away

  • A query fans out to every shard, each returns its top-k, and a coordinator merges — so latency is the slowest shard.

And 3 more inside the class, in Pro.

How the class is laid out

  1. The problem
  2. The simple version
  3. What sharding costs a search query
  4. Near-real-time, and why
  5. Keeping it in sync
  6. Object storage
  7. Uploads
  8. Inverted index
  9. Search clusters
  10. Check your understanding