lesswrong7.0 / 10

LLMs are weirdly below chance on TASTE without a shortcut

Ziqian Zhong

Abstract

We found a shortcut in the TASTE benchmark : mech-interp-related proposals are generally scored lower. On the non-interp half, all tested models with ECI > 158 are below 50% on the rubric-only setup, with 8 of 14 significantly below (7 of them OpenAI). In particular, OpenAI models' scores seem to decrease with higher ECI (r = -0.74), suggesting a systematic bias. The shortcut The TASTE benchmark is a benchmark where models decide which of two AI-safety research proposals is preferred by domain experts [1] . In trying to understand the quality of the benchmark, we realized one recurring theme that the mech-interp-related proposals in there are quite bad. We therefore tested a simple baseline: compare the number of mech-interp related terms (without deduplication) on the two proposals, and pick the one with fewer such terms, coin flip on ties. Surprisingly, this shortcut is able to achieve a 63.0% overall accuracy, beating all the LLMs we tested [2] . The list of mech-interp related terms we use probe, probes, probed, probing, patch, patches, patched, patching, lens, SAE, SAEs, sparse autoencoder, sparse autoencoders, interpretability, attention head, attention heads, residual stream

Research area

benchmarksevalsevaluation
Published
15 Nov 2026
Source
lesswrong
Org
Alignment Forum
View paper
Sign in to read and join the discussion.