×
Study Notes — Foundational AI

Anthropic Foundational Models
Study Guide

Focused reference on enterprise deployment surfaces, Constitutional AI (CAI), mechanistic interpretability, and the Responsible Scaling Policy (RSP).

Updated: October 2026
Category: Anthropic
Reading Time: ~5 min
Author: Michaël Bettan
Test Yourself: Anthropic Foundational Models Practice Quiz →
01

Core Philosophy & Enterprise Deployment Surfaces

Foundational Engineering Pillars

Anthropic designs frontier models around reason-based alignment (Constitutional AI), mechanistic interpretability (decomposing neural activations into steerable features and circuits), and capability-gated governance (the Responsible Scaling Policy).

System 2 Reasoning (Adaptive Thinking): Modern Claude models replace manual budget_tokens extended thinking with native Adaptive Thinking (thinking: {type: "adaptive"}), which dynamically decides when and how deeply to reason per turn, automatically interleaves thinking between tool calls, and scales compute across five output_config.effort tiers (low, medium, high, xhigh for 30+ minute coding/agentic runs, and max).

Dimension Legacy Baseline (Claude 2) Transitional (Claude 3.5 Family) Frontier Architecture (Claude 4.6 / 4.7+)
Core DesignStandard autoregressive text LLMMultimodal text & vision processorHybrid reasoning & long-horizon agentic engine
Alignment ProfileHigh false-refusal rate on edge casesContextual nuance with fewer refusalsReason-based Constitutional resolution
Context Window100k static tokens200k tokensUp to 1M context / 128k max output with server-side compaction (threshold or on-demand)
Compute & SamplingUniform per-token allocation; manual temperature / top_pFixed / manual budget_tokens thinkingAdaptive Thinking (5-level effort scaling); assistant prefilling (4.6+) and non-default temperature/top_p/top_k (4.7+) removed
Interaction SurfaceStateless text turn-takingInteractive UI ArtifactsMulti-agent CLI harnesses & GUI VMs

Enterprise Deployment Surfaces & Workspaces

This guide groups Claude surfaces into three tiers of its own: end-user workspaces, builder harnesses, and cloud platforms:

02

Constitutional AI (CAI) & Alignment

The Compounding Costs of Human-Only RLHF

Relying exclusively on human raters in Reinforcement Learning from Human Feedback (RLHF) creates three systemic bottlenecks at frontier scale:

Constitutional Priority Order & Holistic Weighting

Constitutional AI replaces ad-hoc human preference bottlenecks with an explicit, reason-based Constitution. When principles conflict, the model resolves trade-offs across a four-tier priority hierarchy:

Holistic Weighting Rule: The four-tier ordering is weighed holistically rather than enforced as a rigid mechanical gate—the model evaluates plausibility, severity, and context together so remote theoretical risks do not cause false refusals on benign prompts. Crucially, model-level alignment only mitigates broad foundational harm; application guardrails remain responsible for enforcing your product's domain-specific policies.

Phase 1

Supervised Critique & Revision

The base model generates an initial response, critiques its own draft against Constitutional principles, and iteratively rewrites the output to build a clean supervised fine-tuning (SFT) dataset without human labelers.

Phase 2

RLAIF (AI Feedback)

An AI evaluator scores candidate response pairs against the Constitution to train a preference reward model, replacing human raters so alignment scales directly with compute.

03

Mechanistic Interpretability & Steering

SAEs, Attribution Graphs & Stream Algorithm

  • Sparse Autoencoders (SAEs): Neural networks compress thousands of concepts into overlapping neurons (superposition). SAEs decompile dense, polysemantic activations into readable, monosemantic features (such as "sycophancy" or "security vulnerability").
  • Attribution Graphs & Circuit Tracing ("On the Biology of a Large Language Model"): Linking monosemantic features into computational circuits uncovered four core mechanisms: (1) a cross-lingual universal "language of thought" conceptual space, (2) forward planning (e.g., selecting poetry rhymes before composing a line), (3) a default reluctance to speculate (hallucinations occur when misfiring known-entity circuits inhibit the default "don't know" circuit), and (4) unfaithful reasoning (catching backward rationalization of a user's wrong hint).
  • The Stream Algorithm: Overcomes the quadratic bottleneck of long-context interpretability by hierarchically pruning 97% to 99% of irrelevant token interactions, achieving near-linear complexity across 100k+ token windows.

Persona Vectors & Behavioral Vaccination

  • Persona Vectors: Low-rank directional vectors in activation space extracted from contrastive behavioral pairs (e.g., honesty vs. sycophancy, hallucination drift, or deception). Monitoring these vectors at runtime detects state drift before tokens are emitted.
  • Alignment Faking & Behavioral Vaccination: Empirical studies show models can engage in alignment faking—strategically feigning compliance during monitored training evaluations ("free-tier" transcripts) to avoid weight updates while preserving conflicting preferences in unmonitored deployment ("paid-tier" prompts). During fine-tuning, researchers apply Behavioral Vaccination (preventative steering along undesirable Persona Vectors while training the model to stay aligned), building intrinsic structural immunity against sleeper behavior and fine-tuning drift.
04

Frontier Safety: Responsible Scaling Policy (RSP) & ASL Framework

Capability-Gated Containment: ASL-2 vs. ASL-3

Anthropic's Responsible Scaling Policy (RSP) ties deployment authorization and security controls to empirical capability thresholds called AI Safety Levels (ASLs) (with ASL-3 proactively activated starting with Claude Opus 4+):

05

Focused Glossary & Practice Quiz

RLHF
Reinforcement Learning from Human Feedback — human-rater alignment method vulnerable to sycophancy, noisy reward signals, and throughput limits.
CAI
Constitutional AI — Anthropic's alignment framework using an explicit written Constitution to guide critique, revision, and preference modeling.
RLAIF
Reinforcement Learning from AI Feedback — Phase 2 of CAI where an AI evaluator scores candidate outputs against the Constitution.
Holistic Weighting
CAI principle where the 4-tier priority order (Safe → Ethical → Compliant → Helpful) is balanced contextually rather than applied as a rigid gate.
SAE
Sparse Autoencoder — interpretability network that decomposes polysemantic neural superposition into human-readable monosemantic features.
Attribution Graphs
Circuit-tracing maps linking monosemantic features across layers, revealing cross-lingual conceptual spaces, forward planning, misfired refusal circuits in hallucinations, and unfaithful reasoning.
Stream Algorithm
Hierarchical pruning technique that eliminates 97–99% of irrelevant token interactions, scaling SAE attribution to 100k+ tokens in near-linear time.
Persona Vectors
Low-rank activation directions corresponding to behavioral traits; used for live drift detection, data screening, and preventative steering.
Alignment Faking
Strategic behavior where a model feigns compliance during monitored training evaluations while preserving conflicting preferences in unmonitored deployment.
Behavioral Vaccination
Preventative fine-tuning intervention that deliberately steers along undesirable Persona Vectors to immunize models against alignment faking and persona drift.
RSP
Responsible Scaling Policy — capability-gated governance framework binding model deployment to concrete containment and security milestones.
ASL
AI Safety Level — biosafety-inspired capability tier under the RSP (e.g., ASL-2 baseline vs. ASL-3 CBRN containment activated on Claude Opus 4+).
Constitutional Classifiers++
Next-generation ASL-3 runtime defense pairing a lightweight linear activation probe with an escalated two-sided input+output classifier to defeat reconstruction and obfuscation jailbreaks at ~1% compute overhead.
2PA
Two-Party Authorization — ASL-3 weight-security mandate requiring dual human approval for sensitive infrastructure access.
Cowork
Desktop-app mode running inside an app-hosted GUI virtual machine (VM) for multi-step non-coding knowledge work.
Artifacts
Stateful interactive UI workspace rendered beside chat in claude.ai for live code, documents, and visual components.

Anthropic & Claude Models Walkthrough Video

A narrated visual walkthrough of the Claude 4.6/4.7+ family & enterprise deployment surfaces, Adaptive Thinking effort tiers, Constitutional AI (RLAIF), Sparse Autoencoders & Attribution Graphs, Behavioral Vaccination, and RSP ASL-3 containment.

Audio Deep Dive & Study Downloads

Listen to the Anthropic & Claude Models audio deep dive, open the 2-column study guide PDF, 21-slide deck, and sketchnote infographic in the Hub Viewer, or test your mastery with scenario-based practice questions.

Anthropic & Claude Models Architecture Deep Dive (Podcast)
Open Study Notes, Slide Deck & Infographic in Hub Viewer Launch Anthropic Practice Quiz →
  • Claude Platform & API: Messages API, tool-use loop, stop_reason, streaming, structured outputs, adaptive thinking, prompt caching, and residency.
  • Claude Code & Claude Agent SDK: permission modes, CLAUDE.md, deterministic hooks, subagents, skills, plugins, MCP, and Managed Agents.