Apa iku mutation testing?

Question

Accepted Answer

**Mutation testing** ngevaluasi **kualitas saka test suite** kanthi sengaja ngenalake tetêtêsan bug cilik ("mutants") menyang kode lan nyobi manawa tests **makoni dheweke**. Iki nggawe ukuran carane tests apik banget kanggo detect defects — luwih neng segara saka coverage, sing mung nggawe ukuran eksekusi.

## Carane mutation testing bisa dianggo

```text
1. A tool makes small changes (MUTATIONS) to the code, e.g.:
   → change + to -, > to >=, true to false, remove a statement, change a constant
   → each mutation = a deliberate "bug" (a MUTANT version of the code)
2. Run the TEST SUITE against each mutant:
   → tests FAIL → the mutant is "KILLED" (good — tests caught the bug) ✓
   → tests PASS → the mutant "SURVIVED" (bad — tests DIDN'T catch the bug) ✗
3. MUTATION SCORE = % of mutants killed → measures how good the tests are at catching bugs
```

## Kok luwih apik tinimbang coverage

```text
COVERAGE → measures if code was EXECUTED (not if behavior was verified) → can be high with
  weak tests (no real assertions)
MUTATION TESTING → measures if tests actually DETECT bugs (changes in behavior):
  → a surviving mutant reveals a GAP — tests execute that code but don't verify it well
    (weak/missing assertions, untested behavior)
→ A much stronger signal of TEST QUALITY than coverage.
```

## Panimbang

```text
✓ Reveals weak tests (high coverage but surviving mutants = false confidence)
⚠️ COMPUTATIONALLY EXPENSIVE (runs the suite many times — once per mutant) → slow
⚠️ "Equivalent mutants" (mutations that don't change behavior) → false survivors to ignore
→ Tools: Stryker (JS), PIT (Java), mutmut (Python). Use on critical code; run periodically.
```

## Kok iku penting

Pamahaman mutation testing iku ilmu sing berharga kanggo tingkat senior amarga menehi **ukuran kualitas test sing katon luwih kuwat tinimbang coverage**, njawab kalemahane coverage sing utama, dadi berguna kanggo ngevaluasi lan ndandani test suites.

Inisight fundamental iku yen **coverage nggawe ukuran eksekusi, ora verifikasi** — kode bisa "covered" (dieksekusi) dening tests sing ora bener-bener ngoreksi tingkahe (assertions sing lemah utawa ilang), menehi kapercayaan sing palsu. **Mutation testing** njawab iku kanthi nggawe ukuran manawa tests bener-bener **detect bugs**: iku ngenalake tetêtêsan bugs sengaja (mutants) menyang kode lan nyobi manawa tests makoni dheweke (mutant "killed" kanthi tests sing gagal iku apik; mutant "surviving" tegese tests ora makoni bug iku).

**Mutation score** (persentase mutants sing killed) iku sinyal kualitas test sing katon luwih kuwat tinimbang coverage amarga nampakake manawa tests bener-bener ngoreksi tingkahe — **surviving mutant nampakake gap sing bener** (tests ngeksekusi kode nanging ora ngoreksi apik, contone assertions lemah utawa tingkahe sing ora ditest) sing coverage bakal kaliwatan.

Pamahaman iki — yen mutation testing nampakake tests lemah sing ndhedhel ing mburine coverage sing dhuwur — iku nilai utama, njawab kalemahane yen coverage dhuwur ora njamin tests apik.

Pamahaman **panimbang** — yen iku **larang banget computationally** (nganggo suite sak-wanca per mutant, ngomake lambat), yen "equivalent mutants" (mutations ora ngowahi tingkahe) iku survivors palsu sing kudu dilirwakake, lan yen tools ana (Stryker, PIT, mutmut) — ngrembug kesadaran praktis saka kapan lan carane nganggo iku (ing kode kritis, periodik, tinimbang terus-terusan).

Kamangka kualitas tests bener-bener penting (coverage dhewe bisa menehi kapercayaan palsu) lan mutation testing menehi ukuran kuwat banget kanthi nyobi manawa tests bener-bener makoni bugs, lan kamangka pamahaman iku, kaunggulan tinimbang coverage, lan panimbang praktise iku berguna kanggo bener-bener ngevaluasi lan ndandani test suites, pamahaman mutation testing iku ilmu berharga kanggo tingkat senior — teknik sophisticated kanggo nggawe ukuran kualitas test sing bener, njawab kalemahane coverage sing utama, lan ngrembug pangerten luwih dalam saka keefektifan tests sing dikarepake kanggo peran senior sing migatni kualitas tests sing bener, ora mung coverage numbers.