SS

Search

Jump to a page, project or post

All journeys

Kafka mastery in Rust

One evolving pipeline (order events → validated → priced → customer totals, plus a dead-letter topic) built from scratch with rdkafka, growing through nine phases of concept, build, experiment and mastery check.

Overall progress20%

Done means: Understand every knob: partitions and offsets, delivery semantics, exactly-once, consumer-group internals, broker operations, and how it all fails.

Started
22 Jun 2026
Updated
27 Oct 2026
Milestones
1 / 9

Milestones

  1. Phase 0 · KRaft cluster in Docker, Rust toolchainDone
  2. Phase 1 · Log, offset and partition modelPending
  3. Phase 2 · Producers: batching, acks, idempotencePending
  4. Phase 3 · Consumer groups and rebalancingPending
  5. Phase 4 · Delivery semantics, exactly-once, dead-letter queuePending
  6. Phase 5 · Schemas and registryPending
  7. Phase 6 · Three-broker internals and operationsPending
  8. Phase 7 · Stream-processing patternsPending
  9. Phase 8 · Performance, lag tuning, failure drills, capstonePending

Log

  1. Progress figure is a placeholder until the roadmap file is reconciled with this page.

  2. Kicked off. Chose Rust and rdkafka to stay close to the production services I work on.

Phases 0 to 4 are the load-bearing sixty percent. Everything after that is depth.