Evaluating honesty and lie detection techniques on a diverse suite of dishonest models

Abstract

We use a suite of testbed settings where models lie—i.e. generate statements they believe to be false—to evaluate honesty and lie detection techniques. The best techniques we studied involved fine-tuning on generic anti-deception data and using prompts that encourage honesty.

Research area