Quality Regression Post-Mortem — Three Harness Changes Stacked #
May 2026 Feature Updates #
- Claude Code Updates — May 2026 (Releasebot) — PostToolUse hooks now include
duration_ms (tool execution time). hookSpecificOutput.updatedToolOutput now works for all tools, not just MCP. CLAUDE_CODE_FORK_SUBAGENT=1 now works in non-interactive sessions. MCP server connections now happen in parallel rather than serially. - Changes in the system prompt between Claude Opus 4.6 and 4.7 (Simon Willison, 2026-04-18) — Detailed diff: knowledge cut-off language removed in 4.7 (reflecting reliable Jan 2026 cutoff). Vision ceiling raised to 2,576px long edge (~3.75 megapixels, 3× prior models).
- Claude Code Tips I Wish I’d Had From Day One (Marmelab, 2026-04-24) — Practitioner-authentic write-up from French digital agency. Key finding: plan mode before any implementation is the single highest-leverage habit; context window management (not model capability) is the real constraint.
Context Engineering — The New Discipline #
- Context Engineering for Coding Agents (Martin Fowler) — Architectural legitimacy for context engineering as a discipline: MCP as a “Select” technique, CLAUDE.md and skills as configuration-layer context, and structured specs as dynamic injection. The bottleneck in 2026 is not model capability but context quality.
- Context is AI coding’s real bottleneck in 2026 (The New Stack) — 57% of enterprises run agents in production but quality remains the top barrier; “ongoing difficulties with context engineering and managing context at scale” named as the leading quality challenge among large organisations.
Cross-links #
- Claude Integrations MCP is converging as the shared infrastructure for both Claude Code plugins and Claude Cowork/creative connectors — the two ecosystems are sharing protocol.
- Vibe Coding Approaches Context engineering is the discipline that connects Claude Code technique to broader agentic engineering patterns.
- Emerging pattern: The quality regression post-mortem is a new class of Claude Code story — not model capability, not security, but product-layer harness changes degrading model behaviour. Worth tracking as a category: “harness-induced quality regression.”
- Quality signal: Anthropic’s remediation measures (internal dogfooding, ablation gating) represent an institutional response, not just a fix. Whether these hold is worth monitoring.
- Keyword suggestion:
"claude code harness" OR "system prompt change" quality — catches future regressions from this class. - Gap: Boris Cherny / Anthropic-team primary content still sparse in this cycle — regression post-mortem consumed the editorial attention. May return to technique content in May-June.