Menene mutation testing?

Question

Accepted Answer

**Mutation testing** yana auna **ingancin saitin gwaje** ta hanyar tsira abin da ba daidai ba ("mutants") a cikin lambar kuma bincika ko gwajin sun **kama su**. Yana auna menene gwajin suke da kyau a gani-gani masu lahani — waje da kewaye, wanda kawai ya auna jinkirin aiki.

## Yadda mutation testing ke aiki

```text
1. A tool makes small changes (MUTATIONS) to the code, e.g.:
   → change + to -, > to >=, true to false, remove a statement, change a constant
   → each mutation = a deliberate "bug" (a MUTANT version of the code)
2. Run the TEST SUITE against each mutant:
   → tests FAIL → the mutant is "KILLED" (good — tests caught the bug) ✓
   → tests PASS → the mutant "SURVIVED" (bad — tests DIDN'T catch the bug) ✗
3. MUTATION SCORE = % of mutants killed → measures how good the tests are at catching bugs
```

## Me ya sa ya fi kyau fiye da kewaye

```text
COVERAGE → measures if code was EXECUTED (not if behavior was verified) → can be high with
  weak tests (no real assertions)
MUTATION TESTING → measures if tests actually DETECT bugs (changes in behavior):
  → a surviving mutant reveals a GAP — tests execute that code but don't verify it well
    (weak/missing assertions, untested behavior)
→ A much stronger signal of TEST QUALITY than coverage.
```

## Tunawa

```text
✓ Reveals weak tests (high coverage but surviving mutants = false confidence)
⚠️ COMPUTATIONALLY EXPENSIVE (runs the suite many times — once per mutant) → slow
⚠️ "Equivalent mutants" (mutations that don't change behavior) → false survivors to ignore
→ Tools: Stryker (JS), PIT (Java), mutmut (Python). Use on critical code; run periodically.
```

## Me ya sa yana da mahimmanci

Ganewa mutation testing yana da daraja domin yana ba da **karfi mai ƙarfi na auna ingancin gwaje fiye da kewaye**, musamman lokacin kin gane lahani, saboda haka yana aiki don bincika da inganta saitin gwaje.

Muhimmiyar gani ita ce cewa **kewaye yana auna jinkirin aiki, ba bari ba** — lambar za ta iya zama "kewaita" (ta tumbuki ta gwajin) kuma duk da haka gwajin ba su tabbata abin da ake buƙata (raunin bari ko ba a binciki ba), yana ba jikun gida mai amfani. **Mutation testing** yana magance haka ta hanyar auna ko gwajin suke da kyau a gani-gani masu lahani: yana tsira abin da ba daidai ba (mutants) a cikin lambar kuma bincika ko gwajin suke kama su (mutant da "an kashe" ta hanyar gazawar gwajin yana da kyau; mutant "da ya tsira" yana nufin gwajin ba su gani masu lahani ba).

**Gwajin mutants** (kashi na mutants da aka kashe) yana nufin karfi mai ƙarfi na auna ingancin gwaje fiye da kewaye saboda yana fallaci ko gwajin suke da kyau a bari abin da ake buƙata — **mutant da ya tsira yana fallaci waje tabbatacciyya** (gwajin yana tumbuki lambar amma ba shi bari abin da ake buƙata kyau, misali rauni mai lahani ko ba a binciki ba) wanda kewaye za shi tsiranta.
\