Concepts
Question this section answers: Which piece do I touch for storage, buffering, or offsets?
object-log is three cooperating surfaces:
┌─────────────┐ ┌────────────┐ ┌─────────────┐
│ BlobStore │◄────│ LogEngine │────►│ Sequencer │
│ (bytes) │ │ (buffer) │ │ (offsets) │
└─────────────┘ └────────────┘ └─────────────┘What stays outside
| Concern | Owner |
|---|---|
| Kafka wire / record batch codec | Consumer protocol crate (e.g. heimq) |
| Producer id / epoch / sequence | Sequencer::Meta in the consumer |
| Epoch fencing / EOS | Sequencer implementor |
| Hot-tier local fsync | Consumer buffer in front of object-log |
| Retention policy | Consumer; object-log supplies truncate_before mechanism |