Kaanta ta yi ka zaɓi tsarin rarraba-rarraba a Kafka?

Question

Accepted Answer

Zaɓin **tsarin rarraba-rarraba** — yadda abubuwan sauraron ke rarraba jiya cikin rabukan jiya ta jiya — shine mahimmin yanke shawarar ƙira Kafka yana shafar **tsari, aiki da rarraba nauyi**. Maɓalli na rarraba da adadin rarraba dole ne a zaɓi da sannu.

## Yadda rarraba-rarraba ke aiki

```text
A producer's message goes to a partition based on:
  → with a KEY → hash(key) → determines the partition (same key → same partition consistently)
  → no key → distributed (round-robin / sticky) across partitions
→ the KEY choice determines ordering and distribution
```

## Zaɓin maɓalli na rarraba

```text
The KEY determines two crucial things:
  ✓ ORDERING → all events with the same key go to the same partition → ordered together
    (e.g. key=userId → all of a user's events are ordered)
  ✓ DISTRIBUTION → keys should spread evenly across partitions (good cardinality) → balanced load
PITFALLS:
  ✗ LOW cardinality / skewed keys → HOT partitions (one partition overloaded) → bottleneck
  ✗ Wrong ordering scope → if you need per-X ordering, key by X (but that limits parallelism
    within X)
→ choose a key giving the ORDERING you need AND EVEN distribution
```

## Zaɓin adadin rarraba

```text
✓ MORE partitions → more consumer parallelism (throughput), but more overhead/rebalancing
✓ Plan for GROWTH → partition count is hard to reduce; adding partitions breaks key→partition
  mapping (ordering) → size for future scale upfront
✓ Rough guide: enough partitions for peak consumer parallelism (target throughput / per-consumer)
```

## Me ya sa ya mai da mahimmanci

Ganin yadda za a zaɓi tsarin rarraba-rarraba yana da mahimmanci saboda shi ne **mahimmin yanke shawarar ƙira Kafka** yana shafar tsari, aiki, da nauyi, don haka yana da alaƙa da tsara jiya da kyau.

Rarraba-rarraba ita ce tsakiya ga Kafka, kuma zaɓin tsarin (maɓalli da adadi) yana tasiri sosai ga tsarin.

Ganin **yadda rarraba-rarraba ke aiki** — saƙo ke zuwa rarraba bisa ga maɓalli (hash na maɓalli, don maɓalli iri ɗaya kwatancin ya je rarraba iri ɗaya) ko rarraba jiya ba tare da maɓalli ba — yana bayyana tsari.

Ganin yadda za a **zaɓi maɓalli na rarraba** shine yanke shawarar mahimmanci: maɓalli yana ƙayyade **tsari** (duk abubuwan sauraron tare da maɓalli iri ɗaya zuwa rarraba iri ɗaya kuma suna tsari tare, alal misali keying ta hanyar ID mai amfani don tsari abubuwan sauraron na mai amfani) da **rarraba** (maɓalli buƙatun rarraba daidai jiya cikin rarraba don nauyi daidai), tare da mahimmin haɗarori na maɓalli mara yawa ko maɓalli da karkashi na halin **rarraba mai zafi** (nauyi masu yawa, damuwa) da zaɓin tsari ɗin muguɗi.

Shirye-shiryen zaɓin maɓalli yana bayar da tsari da rarraba daidai shine mahimmin ƙwararren aiki.

Ganin yadda za a **zaɓi adadin rarraba** — rarraba da yawa suna baiwa mai abubuwan maliyar aiki da yawa (adadi) amma tare da haɗi, tsara don girma (saboda adadin rarraba yana da wahala a rage kuma ƙara rarraba yana karya tsara maɓalli-zuwa-rarraba ta haka tsari, don haka ka ƙayyade girma don waje gida gida), kuma kusan ƙayyade adadin parallelism na mai ɗabi — yana nufin adadi shawarar yana shafar iyawa.

Wannan rarraba shawarori (maɓalli don tsari/rarraba, adadi don aiki/girma) suna mahimmanci saboda suna samuwa kuma yana da wahala a canja daga baya, kai tsaye yana shafar tsari gaskiya, daidaitaccen nauyi, da iyawa.

Tun da rarraba-rarraba shine tsakiya, samuwa yanke shawarar ƙira Kafka (yana shafar tsari, aiki, da nauyi) yana da wahala a canja daga baya, kuma tun da ganin yadda za a zaɓi maɓalli na rarraba (don tsari da daidaitaccen rarraba, guje wa rarraba mai zafi) da adadi (don aiki da girma) yana mahimmanci don tsara jiya da kyau, ganin yadda za a zaɓi tsarin rarraba-rarraba yana mahimmanci, aiki-aiki hanya Kafka ilimi — mahimmin, samuwa yanke shawarar ƙira (yana shafar tsari, rarraba nauyi, da iyawa) yana buƙatun sannu zaɓin maɓalli na rarraba da adadi, kuma tsakiya ga tsara jiya na Kafka yana tsari daidai, tsara nauyi daidai, kuma iyawa.