lesswrong8.0 / 10

Announcing Control Tower

ScottWofford

Abstract

An open-source framework for running and comparing AI control research We built Control Tower , an open-source framework built on Inspect for running AI control evaluations, and the Control Leaderboard , which compares control protocols and monitors across environments. Coding agents make it faster for researchers to build environments for their own research, so they can test new control techniques quickly. However, each new paper runs on its own environments, monitors and scoring, so control techniques are hard to compare or replicate across papers. Also, once a paper is published, its code is rarely maintained, so its techniques seldom get tested again on new environments or models. How can researchers keep moving quickly with their AI control research agendas, while enabling others to replicate and build on their results? With Control Tower, our team ports researchers' environments and techniques into shared evaluation infrastructure, so research results can be replicated, compared and built on. This post outlines how we (1) port research, (2) compare metrics and (3) update the framework with new models and features, as well as our roadmap. (1) We port settings and protocols fro

Research area

agentic evaluationai controlevals
Published
16 Nov 2026
Source
lesswrong
Org
Alignment Forum
View paper
Sign in to read and join the discussion.