CCARP-D3.2 · Domain 3 · Integration · 19% of CCA-P

Accuracy-Latency-Cost Tradeoff Analysis.

5 min read·7 sections·Tier A

Every production Claude deployment sits on a capability/speed/cost triangle, and the exam trap is treating it as one dial ('use the biggest model') instead of independent levers - model tier, effort, thinking budget, prompt caching, and batching - that trade one axis for another *within* a single model choice, not just across the model family. Anthropic model-selection guide

Official Anthropic model-selection guidanceCCA-P Domain 3 · IntegrationAlso tested in Domain 4
Accuracy-Latency-Cost Tradeoff Analysis, hero illustration featuring Loop mascot in a warm gallery scene.
Domain CCARP-D3Integration · 19%
On this page
01 · Summary

TLDR

Every production Claude deployment sits on a capability/speed/cost triangle, and the exam trap is treating it as one dial ('use the biggest model') instead of independent levers - model tier, effort, thinking budget, prompt caching, and batching - that trade one axis for another *within* a single model choice, not just across the model family. Anthropic model-selection guide

3
Trade-off axes
5
Independent levers
up to 2.5x
Fast mode speedup
~50%
Batch API discount
D3 + D4
Exam domains
02 · Definition

What it is

Every production Claude deployment sits on a triangle of capability, speed, and cost, and an architect's job is to pick a defensible point on that triangle per use case rather than defaulting to "use the biggest model everywhere." Anthropic frames model selection explicitly around these three axes, then layers additional knobs - effort, thinking budget, caching, batching - on top.

Those knobs let an architect trade one axis for another within a single model choice, not just across the model family. Justifying a configuration decision means naming which axis was binding (latency SLA, cost budget, or accuracy floor) for that specific pipeline - not restating a generic "use the best model" default.

03 · Mechanics

How it works

Model tier is the first, coarsest lever. Anthropic's own guidance frames Opus as the default for complex agentic/enterprise work, with lighter models reserved for latency- or cost-sensitive paths; the three evaluation criteria to establish up front are capabilities, speed, and cost.

`effort` is a second, finer-grained lever within a model. Recent Opus and Sonnet models expose an effort parameter that trades intelligence for latency/cost *without switching models* - useful for tuning a single deployed model rather than re-architecting per task.

Extended/adaptive thinking trades latency and token cost for reasoning quality. Adaptive thinking lets Claude dynamically decide how much reasoning budget a request needs based on complexity, while manual budget_tokens extended thinking lets an architect set a stated reasoning-token target for a request. `budget_tokens` is a target, not a strict limit - actual thinking-token usage can still run under or over it, especially on complex tasks - so it narrows variance versus adaptive thinking but is not a guaranteed hard ceiling on its own; a real latency SLA still needs a request-level timeout or max_tokens cap as the enforced backstop.

Fast mode is a direct, priced latency-for-cost knob. Fast mode (research preview, Opus 4.7/4.8) delivers up to 2.5x higher output speed at premium pricing - trading dollars directly for latency on a specific request path.

Prompt caching and Batch API optimize token usage and cost-performance directly. Prompt caching typically cuts cost and latency together on repeated context (system prompts, tool defs, long documents) via cache_control breakpoints with 5-minute or 1-hour TTLs - one of the few levers that improves both axes at once rather than trading them, though a cache hit is a faster-and-cheaper *typical* outcome, not a guaranteed one (a cache write still costs more than a plain call, and a miss falls back to full-price processing). The Batch API instead trades latency for cost: async Message Batches processing gets a roughly 50% cost discount versus the realtime Messages API, appropriate only for non-time-sensitive workloads.

Accuracy-Latency-Cost Tradeoff Analysis mechanics, painterly diagram featuring Loop mascot.
04 · In production

Where you'll see it

Overnight compliance classification

Haiku-tier + Batch API + prompt caching on the shared system prompt across 50,000 documents - cost is binding, latency is irrelevant.

Live support chat

Sonnet/Opus with adaptive thinking, no batching - latency and accuracy dominate; effort tunes the single deployed model rather than forcing a tier switch.

05 · Compare

Side-by-side

LeverTradesEffectBest for
Model tier (Haiku/Sonnet/Opus)Capability vs speed vs costCoarsest lever - sets the whole cost/quality baselineSetting the default per use case
`effort` parameterIntelligence vs latency/costFine-tunes ONE model without switching tiersTuning a single deployed model per task
Adaptive / extended thinkingReasoning quality vs latency/tokensAdaptive = dynamic, no target; manual budget_tokens = stated target (not a strict limit)Tighter variance than adaptive; pair with a timeout/max_tokens cap for a true hard ceiling
Fast mode (Opus 4.7/4.8, preview)Speed vs priceUp to 2.5x output speed at premium pricingLatency-critical paths willing to pay more
Prompt cachingCost AND latency togetherRare double-win on repeated contextShared system prompts / tool defs / long docs
Batch APILatency vs cost~50% discount, async-onlyNon-time-sensitive bulk workloads
06 · On the exam

Question patterns

Accuracy-Latency-Cost Tradeoff Analysis exam trap, painterly cautionary scene featuring Loop mascot.

6 V2 questions wired to this concept. Tap an answer to check it instantly - you'll see whether it's right and why - then expand the full breakdown for the mental model and all four rationales.

An insurer classifies 200,000 routine claim documents each day. A fast model is highly accurate on clear forms but weak on a small ambiguous subset; sending every document to the strongest model exceeds both the batch window and budget. Which design best preserves quality where it matters?

Tap your answer to check it.

A travel assistant always runs lexical search, vector search, and a partner API in parallel. Offline tests show the third source improves answers only for rare itinerary-change queries, while tripling retrieval cost for all traffic. Parallelism keeps median latency low but does not fix the cost increase. What is the best adjustment?

Tap your answer to check it.

A research assistant takes eight seconds to complete an answer, but users mainly complain that the interface appears frozen until completion. Measurements show that generation itself dominates the time and the first tokens are available after one second. Which change most directly addresses the reported experience without claiming to reduce total completion time?

Tap your answer to check it.

A product-support search retrieves 80 passages and reranks all of them before every answer. Offline analysis shows that nearly every relevant passage is already present within the first 15 candidates, while reranking the remaining 65 adds substantial latency and cost. What is the best adjustment?

Tap your answer to check it.

A maintenance assistant calls an asset API that returns a 1.8 MB object containing audit history, images, and sensor samples. Answers need only asset status, active alarms, and the latest service date, and profiling shows tool-output transfer and model input dominate latency and cost. What is the best optimization?

Tap your answer to check it.

An interactive agent calls a normally fast, read-only pricing service whose latency has a rare long tail. Sending two identical requests immediately cuts tail latency but nearly doubles request cost at all times. Which hedging policy best balances latency and cost?

Tap your answer to check it.

07 · FAQ

Frequently asked

Does prompt caching ever hurt latency?
Typically not - reads on a cache hit are faster and cheaper than a fresh pass over that context. The trade shows up on the write (first call pays a cache-write premium) and if content changes so often the cache rarely hits, so treat 'faster and cheaper' as the expected outcome on a hit, not an unconditional guarantee.
Is Batch API ever appropriate for a customer-facing agent?
Only for a non-interactive slice of that agent's workload (e.g. nightly re-classification), never for the live turn - it's explicitly async and unsuitable where a user is waiting.
08 · Practice with AI

Work this with your AI

Work this concept hands-on with Claude Code, Codex, or claude.ai. Copy a prompt, paste it into your assistant, and practise in tandem. Each one keeps you active (explain it back, get drilled, or build) rather than just reading.

  • Drill it like the exam (scenario MCQs)
    Practice in the exam's scenario-MCQ format with trap awareness.
  • Explain it back (Feynman)
    Build durable, transferable understanding of a concept you can half-state.
  • Test me, adapting the difficulty
    Active recall practice on a concept you think you know.
  • Check my prerequisites first
    Before studying a concept that keeps not sticking.
  • Find the high-leverage 20%
    When a domain feels too big and you are short on time.
Self-check

Test yourself

Three diagnostic questions on this primitive. Reveal each answer when you have a guess. Want a full 60-question mock? Open the mock hub →

Q1A compliance pipeline classifies 50,000 documents overnight with no user waiting on the result. Which configuration fits, and why?
Haiku-tier + Batch API + prompt caching on the shared system prompt - cost is the binding constraint, latency is irrelevant overnight. The distractor "Opus with adaptive thinking for maximum accuracy" over-pays for capability the task doesn't need and ignores that an overnight batch has no latency constraint to protect.
Q2A live customer-support chat agent needs to feel responsive and still route hard cases correctly. Which levers apply, and which do not?
Sonnet/Opus with adaptive thinking (dynamic reasoning budget) and no batching - latency and accuracy dominate, cost is secondary. The distractor "Batch API for the 50% discount" is wrong here: Batch is async-only and unsuitable for a live chat SLA.
Q3An architect needs a tighter, more predictable reasoning-token target for one endpoint than a best-effort budget. Which thinking control fits, and what must still back it up?
Manual extended thinking with a stated budget_tokens target - it narrows variance versus adaptive thinking, which varies its budget by complexity with no target set at all. The distractor "budget_tokens is a hard ceiling, so no other control is needed" is false - Anthropic's docs state budget_tokens is a target, not a strict limit, and actual usage can still exceed it on a complex request; a genuine hard latency SLA still needs a request timeout or max_tokens cap as the enforced backstop, not budget_tokens alone.
CCARP-D3.2 · CCARP-D3 · Integration

Accuracy-Latency-Cost Tradeoff Analysis, complete.

You've covered the full ten-section breakdown for this primitive, definition, mechanics, code, false positives, comparison, decision tree, exam patterns, and FAQ. One technical primitive down on the path to CCA-F.

More platforms →