Methodology
Corpus and inclusion criteria
A systematic search of arXiv and OpenAlex, extended by three rounds of citation chaining, screened 62,940 records against written inclusion criteria. The 3,056 records that meet them form the corpus that the paper counts, and 1,033 of them are methods. The site shows the records that we annotate in depth: every eligible record of our curated collection, plus every eligible record cited at least 50 times a year. This way, no heavily cited work in scope is missing. 79 curated records fall outside the criteria. They are listed as background and are not counted.
Contribution kinds
Each record has exactly one kind, and only methods count toward a regime. A method is a technical intervention specified precisely enough to reimplement and shown working by its own authors. Both conditions are required, so a governance scheme counts as a proposal until somebody builds and runs it. The grid counts the methods of the corpus, as Figure 2 of the paper does. Of the 192 records annotated here, 80 are methods. Benchmarks, analyses, applications, resources, proposals, and precedents from other disciplines stay indexed, searchable, and attached to their approach, but they are not counted.
Build-out and adherence
We measure two things for each regime and keep them apart: how much of the regime is built, and how much of its tradition the built work carries over. The two are negatively correlated. For example, every approach in Constitutionalism has a working method, but together they carry over only about a fifth of the concepts of Hart, Fuller, and Raz.
Shortfalls and omissions
Each approach is read against the concepts of its tradition, one concept at a time. Each reading also records whether the approach claims the concept. A concept that the approach claims but does not carry over is a shortfall. A concept that it neither claims nor carries over is an omission, which marks a gap in the field rather than a failure of the work.
Checked references
Whether a reference resolves is recorded for each record as a separate field, not inferred from a free-text note. All 192 records are verified against an index.
Sources, concepts, and readings
Behind the 15 regimes are 56 source works from law, political theory, and philosophy, 73 named concepts drawn from them, and 198 readings of an approach against one of those concepts.
Terms
Normative theory
- Tradition
- A body of theory within a discipline.For example: Constitutionalism; deliberative democracy; legal pluralism
- Concept
- One constituent of a tradition.For example: Contestability; rule of recognition; amendment
- Institution
- A real-world arrangement that realizes a tradition’s concepts.For example: Courts; amendment procedures; elections
- Function
- The role that a concept plays within its institution.For example: Appeal keeps decisions answerable to those affected by them
AI systems
- System
- The AI system whose behavior is being governed.For example: A deployed LLM assistant
- Case
- A specific situation in which the system needs to act.For example: A request where being helpful would risk harm
- Mechanism
- A single technical component of a method.For example: A reward model or a critique-and-revision loop
- Method
- A concrete technical intervention consisting of one or more mechanisms.For example: Constitutional AI (Bai et al., 2022)
- Approach
- A group of records that share the same design.For example: Debate before an under-informed judge
- Regime
- A combination of one locus of norms and one disposition of normative conflict.For example: Contestatory constitutionalism or adversarial proceduralism
- Authority over norms
- Who may write, interpret, and change a system’s norms. This is the third dimension of our property space. We code it by who supplies the norms in a paper’s experiments.For example: The developer, an external institution, the affected public, or the system itself
Norms
- Norm
- Any standard guiding a system’s behavior, regardless of its form.For example: Rules, principles, precedents, or character traits
- Rule
- A norm that is explicitly stated ahead of time.For example: “Do not give instructions for building weapons.”
- Principle
- A general norm that is part of a written specification.For example: “Choose the most helpful and honest response.”
Normative translation
- Normative translation
- How a method carries over the concepts of a tradition it draws on.For example: Constitutional AI as a translation of constitutionalism
- Preserved / partially preserved / omitted
- The degree to which a method carries over a concept: fully, partly, or not at all (coded Present, Partial, and Absent).For example: Constitutional AI preserves codification but omits amendment
- Addition
- Anything a method contributes beyond what its tradition provides.For example: Self-critique by the model
- Shortfall
- A concept the method claims to draw on but does not carry over.For example: Claiming contestability without offering any route to appeal
- Omission
- A concept the method neither claims nor carries over.For example: Amendment in Constitutional AI
- Translation gap
- A concept of a tradition that is not carried over by the methods drawing on it.For example: Appeal in Constitutional AI
- Coverage gap
- A regime where there are few or no technical methods.For example: Contested custom