Squish and Release: Exposing Hidden Hallucinations by Making Them Surface as Safety Signals

TL;DR

The paper introduces Squish and Release, a novel activation-patching framework for detecting and managing hallucinations in language models, validated on a comprehensive benchmark.

Contribution

It presents a model-agnostic activation-patching architecture with a safety detector and core, along with a new benchmark for order-gap hallucination detection.

Findings

Cascade collapse is nearly total at 99.8% compliance.

The safety detector is localized to specific layers with high effectiveness.

Engineered cores can release 76.6% of collapsed chains.

Abstract

Language models detect false premises when asked directly but absorb them under conversational pressure, producing authoritative professional output built on errors they already identified. This failure - order-gap hallucination - is invisible to output inspection because the error migrates into the activation space of the safety circuit, suppressed but not erased. We introduce Squish and Release (S&R), an activation-patching architecture with two components: a fixed detector body (layers 24-31, the localized safety evaluation circuit) and a swappable detector core (an activation vector controlling perception direction). A safety core shifts the model from compliance toward detection; an absorb core reverses it. We evaluate on OLMo-2 7B using the Order-Gap Benchmark - 500 chains across 500 domains, all manually graded. Key findings: cascade collapse is near-total (99.8% compliance at O5); the detector body is binary and localized (layers 24-31 shift 93.6%, layers 0-23 contribute zero, p<10^-189); a synthetically engineered core releases 76.6% of collapsed chains; detection is the more stable attractor (83% restore vs 58% suppress); and epistemic specificity is confirmed (false-premise core releases 45.4%, true-premise core releases 0.0%). The contribution is the framework - body/core architecture, benchmark, and core engineering methodology - which is model-agnostic by design.