Optimizacija Kafke vključuje konfiguriranje producentov, porabnikov, brokersov in tem za želeno ravnovesje med pretokom, zakasnjenjem in trajnostjo. Razumevanje ključnih parametrov za nastavljanje in kompromisov je pomembno za visoko zmogljivo Kafko.
Nastavljanje producentov
✓ BATCHING → batch.size + linger.ms → batch messages → higher THROUGHPUT (fewer requests)
at the cost of slight latency
✓ COMPRESSION → compress batches (snappy, lz4, zstd) → less network/storage, more throughput
✓ acks → acks=all (durable, slower) vs acks=1 (faster, less safe) → durability vs throughput
✓ buffer.memory, max.in.flight → tune for throughput
Nastavljanje porabnikov
✓ fetch.min.bytes / fetch.max.wait → batch fetches → throughput vs latency
✓ max.poll.records → how many records per poll (processing batch size)
✓ Enough CONSUMERS and PARTITIONS for parallelism (the main scaling lever)
✓ Efficient processing (don't block; process in parallel/async where possible)
