Back to papers
arxiv9.0 / 10

ADMITBench: A Safety-Governed Reference Framework for Evaluating the Admissibility of Industrial LLM Advisories

Yash Misra, Javal Vyas, Siddharth Gutta, Mehmet Mercangöz

Abstract

This white paper presents ADMITBench, a reference framework for evaluating industrial LLM advisories at the level of the proposed action. The framework implements a versioned, safety-governed evaluation contract that checks whether a recommendation is supported by the available evidence, permitted under the stated authority and procedure, and acceptable under the plant-specific consequence checks encoded in the selected evaluation profile. In this report, \emph{safety-governed} means that eligibility is determined through explicit, non-compensatory checks derived from a versioned plant profile; it does not mean that the evaluator, model, or plant has been safety-certified. Release 0.1.0 is a public reference implementation for technical and research evaluation, not an authorisation for physical execution.

Research area

ai risk managementevaluationssystemic governance & auditability
Published
4 Aug 2026
Source
arxiv
Org
Refiant
View paper
Sign in to read and join the discussion.