CCARP-D3.2 · Domain 3 · Integration · 19% of CCA-P

Accuracy-Latency-Cost Tradeoff Analysis.

5 min read·7 sections·Tier A

Every production Claude deployment sits on a capability/speed/cost triangle, and the exam trap is treating it as one dial ('use the biggest model') instead of independent levers - model tier, effort, thinking budget, prompt caching, and batching - that trade one axis for another *within* a single model choice, not just across the model family. Anthropic model-selection guide

Official Anthropic model-selection guidanceCCA-P Domain 3 · IntegrationAlso tested in Domain 4
Accuracy-Latency-Cost Tradeoff Analysis, hero illustration featuring Loop mascot in a warm gallery scene.
Domain CCARP-D3Integration · 19%
On this page
01 · Summary

TLDR

Every production Claude deployment sits on a capability/speed/cost triangle, and the exam trap is treating it as one dial ('use the biggest model') instead of independent levers - model tier, effort, thinking budget, prompt caching, and batching - that trade one axis for another *within* a single model choice, not just across the model family. Anthropic model-selection guide

3
Trade-off axes
5
Independent levers
up to 2.5x
Fast mode speedup
~50%
Batch API discount
D3 + D4
Exam domains
02 · Definition

What it is

Every production Claude deployment sits on a triangle of capability, speed, and cost, and an architect's job is to pick a defensible point on that triangle per use case rather than defaulting to "use the biggest model everywhere." Anthropic frames model selection explicitly around these three axes, then layers additional knobs - effort, thinking budget, caching, batching - on top.

Those knobs let an architect trade one axis for another within a single model choice, not just across the model family. Justifying a configuration decision means naming which axis was binding (latency SLA, cost budget, or accuracy floor) for that specific pipeline - not restating a generic "use the best model" default.

03 · Mechanics

How it works

Model tier is the first, coarsest lever. Anthropic's own guidance frames Opus as the default for complex agentic/enterprise work, with lighter models reserved for latency- or cost-sensitive paths; the three evaluation criteria to establish up front are capabilities, speed, and cost.

`effort` is a second, finer-grained lever within a model. Recent Opus and Sonnet models expose an effort parameter that trades intelligence for latency/cost *without switching models* - useful for tuning a single deployed model rather than re-architecting per task.

Extended/adaptive thinking trades latency and token cost for reasoning quality. Adaptive thinking lets Claude dynamically decide how much reasoning budget a request needs based on complexity, while manual budget_tokens extended thinking lets an architect set a stated reasoning-token target for a request. `budget_tokens` is a target, not a strict limit - actual thinking-token usage can still run under or over it, especially on complex tasks - so it narrows variance versus adaptive thinking but is not a guaranteed hard ceiling on its own; a real latency SLA still needs a request-level timeout or max_tokens cap as the enforced backstop.

Fast mode is a direct, priced latency-for-cost knob. Fast mode (research preview, Opus 4.7/4.8) delivers up to 2.5x higher output speed at premium pricing - trading dollars directly for latency on a specific request path.

Prompt caching and Batch API optimize token usage and cost-performance directly. Prompt caching typically cuts cost and latency together on repeated context (system prompts, tool defs, long documents) via cache_control breakpoints with 5-minute or 1-hour TTLs - one of the few levers that improves both axes at once rather than trading them, though a cache hit is a faster-and-cheaper *typical* outcome, not a guaranteed one (a cache write still costs more than a plain call, and a miss falls back to full-price processing). The Batch API instead trades latency for cost: async Message Batches processing gets a roughly 50% cost discount versus the realtime Messages API, appropriate only for non-time-sensitive workloads.

Accuracy-Latency-Cost Tradeoff Analysis mechanics, painterly diagram featuring Loop mascot.
04 · In production

Where you'll see it

Overnight compliance classification

Haiku-tier + Batch API + prompt caching on the shared system prompt across 50,000 documents - cost is binding, latency is irrelevant.

Live support chat

Sonnet/Opus with adaptive thinking, no batching - latency and accuracy dominate; effort tunes the single deployed model rather than forcing a tier switch.

05 · Compare

Side-by-side

LeverTradesEffectBest for
Model tier (Haiku/Sonnet/Opus)Capability vs speed vs costCoarsest lever - sets the whole cost/quality baselineSetting the default per use case
`effort` parameterIntelligence vs latency/costFine-tunes ONE model without switching tiersTuning a single deployed model per task
Adaptive / extended thinkingReasoning quality vs latency/tokensAdaptive = dynamic, no target; manual budget_tokens = stated target (not a strict limit)Tighter variance than adaptive; pair with a timeout/max_tokens cap for a true hard ceiling
Fast mode (Opus 4.7/4.8, preview)Speed vs priceUp to 2.5x output speed at premium pricingLatency-critical paths willing to pay more
Prompt cachingCost AND latency togetherRare double-win on repeated contextShared system prompts / tool defs / long docs
Batch APILatency vs cost~50% discount, async-onlyNon-time-sensitive bulk workloads
06 · On the exam

Question patterns

Accuracy-Latency-Cost Tradeoff Analysis exam trap, painterly cautionary scene featuring Loop mascot.
A compliance pipeline classifies 50,000 documents overnight with no user waiting on the result. Which configuration fits, and why?
Haiku-tier + Batch API + prompt caching on the shared system prompt - cost is the binding constraint, latency is irrelevant overnight. The distractor "Opus with adaptive thinking for maximum accuracy" over-pays for capability the task doesn't need and ignores that an overnight batch has no latency constraint to protect.
A live customer-support chat agent needs to feel responsive and still route hard cases correctly. Which levers apply, and which do not?
Sonnet/Opus with adaptive thinking (dynamic reasoning budget) and no batching - latency and accuracy dominate, cost is secondary. The distractor "Batch API for the 50% discount" is wrong here: Batch is async-only and unsuitable for a live chat SLA.
An architect needs a tighter, more predictable reasoning-token target for one endpoint than a best-effort budget. Which thinking control fits, and what must still back it up?
Manual extended thinking with a stated budget_tokens target - it narrows variance versus adaptive thinking, which varies its budget by complexity with no target set at all. The distractor "budget_tokens is a hard ceiling, so no other control is needed" is false - Anthropic's docs state budget_tokens is a target, not a strict limit, and actual usage can still exceed it on a complex request; a genuine hard latency SLA still needs a request timeout or max_tokens cap as the enforced backstop, not budget_tokens alone.
Two requests share the same long system prompt and tool definitions; only prompt caching is enabled, nothing else changes. What should the architect expect?
On a cache hit, cost AND latency typically drop together on the cached portion - the rare lever that improves both axes at once rather than trading them. The distractor "latency improves but cost does not change" is wrong - cache reads are billed at a reduced rate versus a fresh pass over that context, so cost drops too. Caveat: the first call still pays a cache-write premium, and this improvement is the typical case on a hit, not a guarantee independent of hit rate.
An architect defends a Sonnet + `effort`-tuned configuration to a stakeholder who insists Opus must be used 'for accuracy.' What's the strongest counter grounded in this objective?
The effort parameter is a finer-grained lever within a model - the specific binding constraint (SLA, cost budget) should justify a coarser model-tier jump, not a default to "biggest model always wins." The distractor "Opus always outperforms Sonnet regardless of task complexity" restates the generic-default trap this objective explicitly tests against.
07 · FAQ

Frequently asked

Does prompt caching ever hurt latency?
Typically not - reads on a cache hit are faster and cheaper than a fresh pass over that context. The trade shows up on the write (first call pays a cache-write premium) and if content changes so often the cache rarely hits, so treat 'faster and cheaper' as the expected outcome on a hit, not an unconditional guarantee.
Is Batch API ever appropriate for a customer-facing agent?
Only for a non-interactive slice of that agent's workload (e.g. nightly re-classification), never for the live turn - it's explicitly async and unsuitable where a user is waiting.
08 · Practice with AI

Work this with your AI

Work this concept hands-on with Claude Code, Codex, or claude.ai. Copy a prompt, paste it into your assistant, and practise in tandem. Each one keeps you active (explain it back, get drilled, or build) rather than just reading.

  • Drill it like the exam (scenario MCQs)
    Practice in the exam's scenario-MCQ format with trap awareness.
  • Explain it back (Feynman)
    Build durable, transferable understanding of a concept you can half-state.
  • Test me, adapting the difficulty
    Active recall practice on a concept you think you know.
  • Check my prerequisites first
    Before studying a concept that keeps not sticking.
  • Find the high-leverage 20%
    When a domain feels too big and you are short on time.
Self-check

Test yourself

Three diagnostic questions on this primitive. Reveal each answer when you have a guess. Want a full 60-question mock? Open the mock hub →

Q1A compliance pipeline classifies 50,000 documents overnight with no user waiting on the result. Which configuration fits, and why?
Haiku-tier + Batch API + prompt caching on the shared system prompt - cost is the binding constraint, latency is irrelevant overnight. The distractor "Opus with adaptive thinking for maximum accuracy" over-pays for capability the task doesn't need and ignores that an overnight batch has no latency constraint to protect.
Q2A live customer-support chat agent needs to feel responsive and still route hard cases correctly. Which levers apply, and which do not?
Sonnet/Opus with adaptive thinking (dynamic reasoning budget) and no batching - latency and accuracy dominate, cost is secondary. The distractor "Batch API for the 50% discount" is wrong here: Batch is async-only and unsuitable for a live chat SLA.
Q3An architect needs a tighter, more predictable reasoning-token target for one endpoint than a best-effort budget. Which thinking control fits, and what must still back it up?
Manual extended thinking with a stated budget_tokens target - it narrows variance versus adaptive thinking, which varies its budget by complexity with no target set at all. The distractor "budget_tokens is a hard ceiling, so no other control is needed" is false - Anthropic's docs state budget_tokens is a target, not a strict limit, and actual usage can still exceed it on a complex request; a genuine hard latency SLA still needs a request timeout or max_tokens cap as the enforced backstop, not budget_tokens alone.
Last reviewed: 2026-05-04·Refresh cadence: monthly
CCARP-D3.2 · CCARP-D3 · Integration

Accuracy-Latency-Cost Tradeoff Analysis, complete.

You've covered the full ten-section breakdown for this primitive, definition, mechanics, code, false positives, comparison, decision tree, exam patterns, and FAQ. One technical primitive down on the path to CCA-F.

More platforms →