Luffy LiuLuffy Liu

A method worth keeping close.

Andrew Ng · illustrated avatarAndrew NgAnalytical perspectiveAN-P03

PRODUCT ADVISORY COUNCIL

Find the important failure step

Locate the steps that most often damage the final result.

Product Advisory Council · Method card
Andrew Ng · illustrated avatarAndrew NgAnalytical perspectiveAN-P03

The method

Find the important failure step

Locate the steps that most often damage the final result.

When to use it

  • An unstable multi-step AI workflow.

Ask yourself

  • Should we change the model or the prompt?

Put it into action

  • Inspect a few failed traces, categorize the errors, and improve the dominant cause before expanding sampling.

Keep these limits in mind

  • Use human performance as a reference only when appropriate. Step scores must not obscure overall workflow problems.
Method summary · Not a personal quote

An analytical method adapted from the public skill package, not a reply or endorsement by the person represented.
View the public method source ↗