lesswrong

What Futures Do AI Models Want? An Exploratory Character Evaluation of AI for AI Strategy

Hans Gundlach

Abstract

(This is cross-posted from my blog ) Epistemic Status: Evaluation represents approximately 2 weeks of work. This is mostly exploratory evaluation, and the code for evaluation was made using LLMs. “Before I draw nearer to that stone to which you point, answer me one question. Are these the shadows of the things that will be, or are they shadows of things that may be only?” ~ Charles Dickens Models may soon be involved in some of the most important decisions humanity makes about its long-term future. These include choices about the proliferation of digital minds, tradeoffs between extinction risk and loss of human control, whether to race toward or pause AGI development, and which interventions to prioritize for humanity’s deep future. While there may not be clear answers to many of these questions, some choices are better. It is therefore important to understand models’ preferences and character, both to evaluate the decisions they might make and to understand how they could influence our own. Even without fully delegating these decisions to AI systems, they may have substantial influence through advice, research, and recommendations (see this study from Anthropic ). I’ve developed

Published
15 Nov 2026
Source
lesswrong
Org
Alignment Forum
View paper
Sign in to read and join the discussion.