Producers da consumers suna aiki yaya a Kafka?

Question

IT Interview Practice · Accepted Answer

**Producers** suna buga (rubutu) abubuwan da suka faru zuwa jigogen Kafka, kuma **consumers** suna lanba (karanta) abubuwan da suka faru daga cikinta. Fahimtar yaya suke aiki — gaba da ragewa, offsets, da ƙungiyoyin consumers — abubuwa ne na mahimmanci don yin amfani da Kafka.

## Producers — rubutu abubuwan da suka faru

```text
PRODUCERS publish events to TOPICS:
  → send a record (key, value) to a topic
  → the key determines the PARTITION (same key → same partition → ordering for that key);
    no key → distributed (round-robin)
  → can configure ACKNOWLEDGMENTS (acks) for durability (wait for replicas to confirm)
  → batching, compression for throughput
```

## Consumers — karanta abubuwan da suka faru

```text
CONSUMERS subscribe to topics and read events:
  → read from partitions, tracking their OFFSET (position) → resume from where they left off
  → read at their OWN PACE (events are retained); can re-read (replay) from any offset
  → COMMIT offsets to record progress (so they don't reprocess on restart)
```

## Ƙungiyoyin consumers (mahimmanci don girowa)

```text
CONSUMER GROUP → consumers working together to consume a topic:
  → each partition is consumed by ONE consumer in the group → parallel processing
    (distribute partitions across the group's consumers)
  → add consumers (up to the partition count) to scale consumption
  → if a consumer fails, its partitions are REBALANCED to others (fault tolerance)
DIFFERENT GROUPS → each group reads ALL the events independently (pub/sub: many groups
  each get the full stream)
```

## Me ya sa ya mahalaci

Fahimtar yaya producers da consumers ke aiki yana da mahimmanci saboda su ne **ka waje keɓe keɓe data a shiga da waje daga Kafka**, saboda haka yana da mahimmanci don yin amfani da Kafka.

Producers suna rubuta abubuwan da suka faru kuma consumers suna karantawa su — jinjina ta basirar basirar data.

Fahimtar **producers** — buga abubuwan da suka faru zuwa jigoge, tare da **batu na ƙayyade ragewa** (batu guda yana zuwa ragewar guda don tsari, babu batu yana rarraba round-robin), saita karbawar abubuwan don tsattsaurin lokaci, da ƙunkuntar abubuwan don abin samarwa — yana ƙafa yadda data ke shiga Kafka.

Fahimtar **consumers** — karantawa abubuwan da suka faru yayin da suke bin gida offset (wuri) don komawa daga inda suka tashi, karantawa a saurin nasu saboda abubuwan suke ajiye, yin ƙarfafawa daga offset na daya, da ƙayyada offsets don rubuta ci gaba — yana ƙafa yadda data ke karantawa, ciki har da ƙarfafawa na Kafka da ban mamaki.

Mafi mahimmanci, fahimtar **ƙungiyoyin consumers** yana da mahimmanci don ƙilin girowa na Kafka: consumers suna aiki tare inda **kowane ragewa ana sha'awa shi da ɗaya consumer a cikin ƙungiya** (yana ɓa damar aiki daidai, girowa ta ƙara consumers zuwa ƙidida ragewa), tare da sabon daidaita na atomatik idan consumer ya gaza (kariya), yayin da **ƙungiyoyin consumers daban-daban kowannen ɗaya suna karantawa duk abubuwan da suka faru kai tsaye** (yana ɓa damar pub/sub inda ƙungiyoyin mutane daban-daba kowannen ɗaya suna samun jinjinar cikakke).

Haƙin ƙungiyar consumers na gida yana da mahimmanci ga yadda Kafka ke girowa karantawa kuma yana goyan bayan duka queue-like (a cikin ƙungiya) da pub/sub (jiya ƙungiyoyi).

Tunda producers da consumers ne ka waje keɓe keɓe data a shiga da waje daga Kafka, kuma tunda fahimtar aiki nasu — ragewa, offsets, sake dada, da musamman ƙungiyoyin consumers (batu na mahimmanci ga girowa da daidaita queue/pub-sub) — yana da mahimmanci don yin amfani da Kafka, fahimtar yaya producers da consumers ke aiki yana da mahimmanci, ilimi na asali na Kafka — mahimmanci ga basirar basirar data a Kafka, tare da ƙungiyoyin consumers yana da mahimmanci musamman don fahimtar ƙilin girowa da ƙilin karantawa na Kafka, kuma ya zama dole domin kowa da ke yin amfani da Kafka.

Producers — rubutu abubuwan da suka faru

Consumers — karanta abubuwan da suka faru

Ƙungiyoyin consumers (mahimmanci don girowa)

Me ya sa ya mahalaci

Tambayoyi masu alaƙa