Luffy LiuLuffy Liu

A method worth keeping close.

Andrej Karpathy · illustrated avatarAndrej KarpathyAnalytical perspectiveAK-P04

PRODUCT ADVISORY COUNCIL

No errors does not mean correct

A system can run successfully while producing persistent logical errors.

Product Advisory Council · Method card
Andrej Karpathy · illustrated avatarAndrej KarpathyAnalytical perspectiveAK-P04

The method

No errors does not mean correct

A system can run successfully while producing persistent logical errors.

When to use it

  • A running system has unusual quality or stability problems.

Ask yourself

  • The program runs. Is it ready to deliver?

Put it into action

  • Use simple cases and controls to inspect intermediate data and outputs. Verify that required information actually influences the result.

Keep these limits in mind

  • Tests must address plausible failure modes, not create confidence through irrelevant volume.
Method summary · Not a personal quote

An analytical method adapted from the public skill package, not a reply or endorsement by the person represented.
View the public method source ↗