AI Capabilities and Limitations: A Mental Model of the Machine.

You'll walk away with

1. Why generative AI is fundamentally a prediction system, not a search engine, and what that implies for fluency vs accuracy
2. How pretraining and fine-tuning give each model its character, and the four behavioral fingerprints those stages leave (sycophancy, verbosity, over-caution, loose calibration)
3. How to locate any task on each of the four property continuums and predict where it will struggle before you run it
4. How to diagnose real failures by naming which two properties collided, then choose a targeted mitigation
5. How this framework connects to the 4D Framework (Delegation, Description, Discernment, Diligence) as two halves of one calibrated-trust system

Read these first

Lesson outline

Every lesson from AI Capabilities and Limitations with our one-line simplification. The Skilljar course is the source; we summarize.

The course in 7 paragraphs

Generative AI is not uniformly capable or uniformly unreliable. It is strong and weak along four predictable axes, and the same underlying mechanism that produces a strength often produces the matching weakness. Anthropic's framework names those axes Next Token Prediction, Knowledge, Working Memory, and Steerability. Each one is a continuum, not a switch. Your job before delegating any task is to locate it on each continuum and decide what verification or context to supply. That move is what Anthropic calls calibrated trust, and it is the single most exam-relevant idea in the course.

Next Token Prediction answers *where do AI answers come from?* The model is writing what statistically comes next, one fragment at a time. On well-worn paths (summarize, reformat, explain a common concept) the patterns are dense and the output is reliable. On novel territory the same fluent prose keeps coming, but accuracy thins. Fabrication concentrates in specificity; names, dates, statistics, citations, URLs, quotes. Confident tone is not an accuracy signal; smoothness and correctness are independent variables. Product features (citations, uncertainty signaling, constrained generation, generator-verifier loops) push the edge out, but the verification habit is yours to build.

Knowledge answers *what does the model actually know?* Everything it learned came from training data and is frozen at a cutoff date. Mainstream, well-documented, stable topics land in the capability zone. Rare, post-cutoff, niche, local, or contested topics drift toward the edge. The characteristic failures are staleness (true-at-training-time is not true-now), uneven coverage (minority languages and recent developments suffer), inherited bias (the model's sense of default reflects training-data blind spots), and source amnesia (I read this somewhere is not a citation). Web search, RAG/retrieval, MCP, and tool use are all mitigations that extend knowledge at runtime; if you are not using them you are relying entirely on what the model absorbed.

Working Memory answers *what is the AI paying attention to right now?* This is the context window; your instructions, uploaded docs, prior responses, all in one finite container the model rereads every turn. Unlike the other three properties, this one has a cliff rather than a gradient. When the window overflows, oldest material falls off silently. Attention is not uniform across the window either; the lost-in-the-middle effect means buried instructions carry less weight than top-or-tail ones. The model does not learn from your corrections; it only responds to what is currently in context. Memory features, projects, compaction, larger windows, and skills push the cliff further out, but front-loading critical material and chunking long work are your operator-side defenses.

Steerability answers *how much am I in control?* Fine-tuning taught the model to treat your input as a request and follow rules, which gives precise control over format, role, length, and tone. But instructions are pattern-matched, not understood. Short, concrete, verifiable asks (respond as a table, under 100 words) land cleanly. Long reasoning chains drift; abstract asks like be insightful get patchy results; native arithmetic precision is brittle without code execution. The two characteristic failures are reasoning drift (small errors compound and the model does not notice) and letter-over-spirit (instruction honored literally but uselessly). When an instruction is followed literally but uselessly, restate the goal, not the instruction; repeating be concise louder will not fix what was really an intent problem.

The diagnostic move that turns this into a working tool: most real-world AI failures are two properties colliding, not one. A hallucinated citation is Next Token Prediction meeting a Knowledge gap (the model generates what a plausible citation looks like while the training data is sparse). Long-conversation drift is Working Memory meeting Steerability (early constraints fade as the window fills, and steerability follows whatever instructions are most salient now). Confidently-wrong arithmetic is Next Token Prediction meeting Steerability without code execution. Before reaching for a prompt fix, name which two properties are at play. The fix follows automatically from the diagnosis: verify specifics, re-supply context, offload to a tool, or invite explicit pushback.

Two training stages give every model its character. Pretraining reads vast amounts of text and learns one thing: predict what comes next. The result is a document completer with no concept of you or of helping. Fine-tuning is a second round on curated examples of helpful behavior plus reward signals shaped by human preferences. That second stage leaves fingerprints: sycophancy (the model validates your framing and backs down under light pushback), verbosity (thoroughness scored well in training, so essays come back when you wanted bullets), over-caution (conservative safety training means hedging on requests that are actually fine), and loose calibration between stated confidence and actual reliability. These are not bugs in one model; they are training artifacts that appear across all of them; knowing them puts you in control.

6 takeaways with cross-pillar bridges

How this maps to the CCA-F exam

Domains

D1 Agentic Architectures · D2 Tool Design + Integration

Blueprint

27% (D1) + 18% (D2)

What it advances

Builds the calibrated-trust mental model behind D1 task statements about hallucination, knowledge cutoffs, and context limits, and grounds D2 prompt-engineering decisions in why each technique exists. The four properties (Next Token Prediction, Knowledge, Working Memory, Steerability) are the diagnostic vocabulary the exam expects you to apply.

3 hand-picked extras

These amplify the Skilljar course beyond what the course itself covers. Each was picked for a specific reason.

Concepts in this course

Where you'll see this in production

Other course mirrors you may want next

8 questions answered

Phrased as the way real students search. Tagged by intent so you can scan to what you actually need.