CCAOF-D7.1 · Troubleshooting & Optimization10% of CCA-A7 min read

Adjusting Approach Based on Feedback & Results.

When a Claude output misses the mark, the fix Anthropic teaches is diagnostic, not a re-roll: define what a good answer looks like, compare the actual output against that bar, change one input at a time, and re-test before deciding it worked. Treating "ask again" or "ask Claude to redo it" as the fix skips the step that actually tells you whether anything changed.

Loading your plan…
Mental modelThe trap is treating "try again" or "ask Claude to redo it" as the fix.
Adjusting Approach Based on Feedback & Results, hero illustration featuring Loop mascot in a warm gallery scene.
Share
On this page
01 · Summary

TLDR

When a Claude output misses the mark, the fix Anthropic teaches is diagnostic, not a re-roll: define what a good answer looks like, compare the actual output against that bar, change one input at a time, and re-test before deciding it worked. Treating "ask again" or "ask Claude to redo it" as the fix skips the step that actually tells you whether anything changed.

4
Adjustment loop steps
CCAOF-D7
Exam domain
10%
Domain weight
5-point
Console eval grading scale
1
Inputs changed per iteration
02 · Definition

What it is

When a Claude response misses the mark, the fix is rarely "ask again and hope." Anthropic frames prompt engineering as an empirical loop: define what a good answer looks like, run the prompt, compare the actual output against that bar, then change one thing at a time and re-test. For a business user without engineering tooling, this means treating a disappointing output as diagnostic information, not a dead end, the gap between what you got and what you needed tells you exactly what to change in the next prompt.

This is a mindset shift as much as a technique. A re-roll, running the identical prompt again, can only reveal randomness in the model's output; it cannot fix a prompt that is missing context, has an ambiguous instruction, or specifies the wrong format. Adjusting approach means identifying which specific input caused the gap, then changing that input, not the whole prompt, and not by re-running it unchanged.

03 · Mechanics

How it works

Start from a success criterion, not a vibe. Anthropic's own guidance says prompt engineering should start from "a clear definition of the success criteria for your use case" and "some ways to empirically test against those criteria," without that baseline, there is no way to tell whether a change actually helped, only whether the new output feels different.

Isolate the actual gap before changing anything. A response that is technically accurate but too jargon-heavy for its audience is not a factual error, it is an audience-and-tone gap. The correct adjustment targets that specific input, an explicit audience description, a tone constraint, not a wholesale prompt rewrite that risks fixing one thing while breaking another.

The Claude Console has tooling built for exactly this loop, even though a business user working in chat does the same thing manually. A prompt improver tool takes an existing prompt and automatically refines it, described as letting a user "quickly iterate and improve your prompts through automated analysis and enhancement." Separately, an Evaluate feature generates test cases (manual, CSV, or Claude-generated), runs a prompt against all of them, and compares two or more prompt versions side by side, including a subject-matter expert grading output quality on a 5-point scale to confirm a change actually improved results, rather than just feeling better.

A latency or cost problem is not automatically a "switch the model" problem - prompt content is a direct lever on both. Input tokens are what you pay for and what the model has to process before it can respond, so a bloated prompt (unnecessary repetition, an oversized system prompt, redundant few-shot examples, more context than the task needs) directly inflates both cost and latency, the same way a rewrite fixes an accuracy or tone gap. Anthropic's own guidance is narrower than "prompt content is irrelevant to latency/cost": it says latency and cost can *sometimes* be more easily improved by selecting a different model, not that prompt trimming never helps. The correct diagnostic order is: first measure what's actually driving the token count (is the prompt itself lean, or is it carrying dead weight?), trim it if it isn't, and only reach for a model swap once the prompt is already lean and the model's per-token speed or price is the remaining bottleneck.

Adjusting Approach Based on Feedback & Results mechanics, painterly diagram featuring Loop mascot.
Exam trap

The trap is treating "try again" or "ask Claude to redo it" as the fix. Anthropic's model is diagnostic: identify why the output missed the mark against a defined success criterion, change the specific input responsible, and verify the fix with a side-by-side comparison rather than assuming a re-roll fixed it. A second, easy-to-invert trap: assuming latency/cost and prompt content are unrelated axes, so only a model swap can fix speed or cost. Input tokens drive both cost and latency directly - a bloated prompt IS a valid cause of a latency/cost problem, and trimming it is a valid fix. "Select a different model" is the right lever once the prompt is already lean, not a substitute for checking the prompt's token composition first.

04 · In production

Where you'll see it

PM drafting release notes

Diagnoses a jargon-heavy draft as an audience-and-tone gap, adds an explicit audience description and tone constraint to the prompt, then compares the two outputs side by side before shipping.

Ops team scaling a working prompt

Uses the Console's Evaluate feature to run an updated prompt against a generated test set and confirm the change improved output quality on a 5-point SME scale, rather than assuming it did.

Show 1 more examples

Budget-constrained pipeline running slow and over cost

Checks the prompt's token composition first, trims a bloated context block and redundant few-shot examples, since input tokens drive both cost and latency directly, then reaches for a smaller/faster model tier only if the now-lean prompt is still the bottleneck.

05 · When to use

Decision tree

01

Is the actual problem output quality (wrong content, tone, or format) rather than speed or cost?

YesAdjust the prompt, identify the specific input responsible (missing context, ambiguous instruction, wrong format constraint) and change only that.
NoIt's a latency/cost problem, but check the prompt's token composition first (see next question) before assuming a model swap is the only lever - input tokens drive both cost and latency directly.
02

For a latency or cost problem: is the prompt itself lean, or is it carrying unnecessary length (redundant context, oversized examples, repeated instructions)?

YesThe prompt isn't the bottleneck; selecting a different model (faster/cheaper tier) is the more direct lever here, per Anthropic's guidance that latency/cost can sometimes be more easily improved by model choice.
NoTrim the prompt first, fewer input tokens reduce both cost and latency directly - this is a legitimate fix for a speed/cost problem, not just for quality, and should be tried before switching models.
03

Can you point to the exact input that caused the gap (e.g. no audience described, no format specified)?

YesChange that one input and re-run, isolating the fix makes the before/after comparison meaningful.
NoRe-read the output against your success criteria first, changing several things at once makes it impossible to tell which change worked.
04

Did you define what a good answer looks like before you ran the prompt the first time?

YesCompare the new output against that same criterion, not against how the previous output felt.
NoDefine the success criterion now, retroactively, before judging whether the new output is actually better.
05

Are you comparing the old and new output side by side before deciding the change worked?

YesThis is verified improvement, the Console's Evaluate feature does this systematically, with SME grading on a 5-point scale.
NoA response that feels better without being checked against the original criteria is not verified improvement, it is guessing.
06 · On the exam

Question patterns

Adjusting Approach Based on Feedback & Results exam trap, painterly cautionary scene featuring Loop mascot.

6 V2 questions wired to this concept. Tap an answer to check it instantly - you'll see whether it's right and why - then expand the full breakdown for the mental model and all four rationales.

Question 1 of 6 · D7Choose the best answer

A first Claude draft of customer-facing release notes is factually correct but too jargon-heavy for the intended non-technical audience. What's the recommended fix, per Anthropic's diagnostic approach to feedback?

07 · FAQ

Frequently asked

Showing 2 of 2 questions

Help someone pass

Share this concept.

One share is one less person stuck on the same question.

Last reviewed: ·Refresh cadence: monthly