Luffy LiuLuffy Liu

A method worth keeping close.

Boris Cherny · illustrated avatarBoris ChernyAnalytical perspectiveBC-P02

PRODUCT ADVISORY COUNCIL

Test prompts and tools by subtraction

Accumulated instructions may compensate for problems the current model no longer has.

Product Advisory Council · Method card
Boris Cherny · illustrated avatarBoris ChernyAnalytical perspectiveBC-P02

The method

Test prompts and tools by subtraction

Accumulated instructions may compensate for problems the current model no longer has.

When to use it

  • Model changes or accumulated prompts and tools.

Ask yourself

  • Does a longer prompt make the Agent more reliable?

Put it into action

  • Keep a baseline and compare each instruction or tool with and without it. Add guidance only for repeatable defects and validate before deployment.

Keep these limits in mind

  • Ablation is a controlled experiment, not clearing production settings. Keep permissions, safety, data-integrity requirements, baselines, and rollback.
Method summary · Not a personal quote

An analytical method adapted from the public skill package, not a reply or endorsement by the person represented.
View the public method source ↗