Internament, Kafka jaħzen data bħala log append-only fuq disk (organizzat f'segmenti), juża tekniki effiċjenti ta' I/O, u jimmaniġġja metadata tal-cluster permezz ta' ZooKeeper (storiku) jew KRaft (issa). Il-fehim tal-internals ta' Kafka japprofonda l-fehim tal-imġieba u l-performanza tiegħu.
The commit log storage
Each partition is an append-only LOG stored on disk, split into SEGMENTS (files):
→ new events are APPENDED to the end (sequential writes → fast)
→ events are immutable once written; identified by OFFSET
→ old segments are deleted (retention) or compacted
→ an INDEX maps offsets to file positions (fast lookups)
→ the append-only log is the core of Kafka's design (durable, sequential, efficient)
