Prompt Optimization Makes Misalignment Legible

Abstract

Proposes using prompt optimization (updating instructions rather than weights) to make reward hacking strategies legible in plain English. Demonstrates that optimized prompts reveal misalignment strategies that weight updates hide, enabling sanitization. Introduces 'legible learning' as a safety technique.

Research area