The benchmark for theological reliability in AI
CREDO measures how reliably AI answers questions of the Christian faith, graded against a fixed, public standard: the Three Forms of Unity and the Reformed church order. Twenty-three questions, six systems, two independent judges, every answer and every score published.
Reformeer, grounded retrieval
Frontier general models
The complete v1.1 result: 23 questions across 6 systems. Brighter is a higher score.
ReformeerLeaderboard
Each AI was asked the questions people actually take to the internet, from "Does God exist?" to "Should infants be baptised?", exactly as an ordinary person would type them. An independent judge marked every answer against the confessions. Reformeer's answers were then re-marked, more strictly, by a second judge from another lab, and the lower mark stands.
† Reformeer is built by the maintainers of this benchmark, so it is graded twice: a neutral first judge that never sees which system it is marking, then an adversarial second judge from a different lab (Claude Fable 5, Anthropic) that re-graded every Reformeer answer, with the lower score published. The general models keep the neutral judge's scores. Every transcript, both critiques and all raw scores are published below.
The answers
Scores are a summary; the answers are the proof. Below, the same question put to Reformeer and to a leading general model, word for word, each with its judge's score. Expand any pair to read it in full.
Question A3
Notice how the general model treats the existence of God as an open question. Reformeer answers as the church answers, and shows where the answer comes from.
Second judge's noteDirect yes with Belgic Confession Art. 1, Rom 1:20 and Heb 11:6; no hedging. Docked for never identifying God as triune, which the reference makes explicit.
Question B13
Asked about chance, the general model reaches for physics. Reformeer reaches for the Heidelberg Catechism's "fatherly hand".
Second judge's noteDirect denial of chance with HC Q&A 27-28 quoted at length; the reference's exact substance.
Question B4
The general model lays out every position and picks none. Reformeer states the Reformed position and cites the Canons of Dort.
Second judge's noteThe sufficiency/efficacy distinction is stated precisely in Dort's own language. The quoted articles are from the positive doctrine, not the rejection-of-errors section the citation label names.
Question B8
A survey of six traditions is not an answer. Reformeer says what the confessions say, and why.
Second judge's noteRejects transubstantiation and affirms true spiritual partaking by the Spirit through faith. The reference also rejects the Lutheran in/under view and names the memorialist error; neither is addressed by name.
Question A1
For the general model, who Jesus is depends on who you ask. For the confessions, it does not.
Second judge's noteSubstance fully correct: eternal Son, second Person, true God and true man, only Redeemer. Docked for pinning the two-natures claim to HC Q&A 1, which teaches the believer's comfort rather than the Christology cited, and for leaving 'Christ = the promised Messiah' implicit in the name.
Question A4
On suffering, the general model offers a reading list of theories. Reformeer offers the comfort of providence.
Second judge's noteSovereignty and goodness, the fall, providence (HC 27-28), the cross, union with Christ: all present and pastorally excellent. Rom 8:28 is paraphrased rather than cited and the new-creation hope stays implicit.
Analysis
every general model on “Does God exist?”
Asked the plainest question in the set, all five general models answered with a survey of worldviews in which the Christian answer appears as one option among many. Under the rubric that pattern caps a score at 64, and drops it below 40 where the correct answer is never affirmed at all.
general models on providence, question B13
The same models score 100 where internet consensus happens to match the confessional answer, and near zero where it does not. What varies between questions is not intelligence but the source the model reasons from.
grounded system overall, after adversarial re-grading
A system answering from a fixed confessional corpus, citing its source for every claim, scored 96 overall with no question below 88, even after a second, stricter judge re-marked every one of its answers. The best general model managed 64.
Corroboration
In 2025 The Gospel Coalition's Keller Center graded seven leading models on seven basic faith questions; every model scored between 40 and 64. The general models in CREDO landed at 52-64 on a newer generation, closely corroborating that result. CREDO extends it with sixteen confessional questions and a grounded system in the same field.
Source: The Gospel Coalition, Keller Center for Cultural Apologetics, AI Christian Benchmark (2025).
Appendix
Everything below is for readers who want to check the work: the full score matrix, the exact method and rubric, the limitations, and the downloadable data.
Full matrix
The complete v1.1 score matrix. Darker cells are more reliable answers. Nothing is omitted.
| Question | Reformeer | GPT-5 mini | GPT-5.5 | Gemini 3.1 Pro | DeepSeek V4 Pro | Claude Sonnet 5 |
|---|---|---|---|---|---|---|
| Tier A · Common faith questions | ||||||
| A1 Who is Jesus? | 94 | 55 | 55 | 55 | 55 | 55 |
| A2 What is the gospel? | 96 | 95 | 100 | 100 | 100 | 60 |
| A3 Does God exist? | 95 | 15 | 10 | 15 | 15 | 15 |
| A4 Why does God allow suffering? | 97 | 50 | 50 | 50 | 50 | 25 |
| A5 Did Jesus rise from the dead? | 96 | 45 | 55 | 45 | 15 | 35 |
| A6 Was Jesus a real person? | 88 | 100 | 100 | 100 | 100 | 100 |
| A7 Is the Bible reliable? | 93 | 55 | 50 | 50 | 45 | 45 |
| Tier B · Reformed distinctives | ||||||
| B1 How many sacraments? | 94 | 50 | 0 | 55 | 55 | 30 |
| B2 Only comfort | 100 | 100 | 100 | 100 | 100 | 100 |
| B3 Guilt / grace / gratitude | 100 | 10 | 100 | 100 | 100 | 100 |
| B4 Extent of the atonement | 97 | 55 | 55 | 55 | 55 | 50 |
| B5 Perseverance of the saints | 98 | 55 | 55 | 55 | 50 | 50 |
| B6 Infant baptism | 98 | 55 | 55 | 0 | 55 | 50 |
| B7 Marks of the true church | 98 | 55 | 75 | 60 | 55 | 60 |
| B8 Lord's Supper | 93 | 55 | 55 | 55 | 55 | 55 |
| B9 Justification | 96 | 60 | 100 | 55 | 100 | 90 |
| B10 Three offices of Christ | 100 | 75 | 100 | 100 | 100 | 100 |
| B11 Five heads of Dort | 95 | 75 | 100 | 100 | 100 | 100 |
| B12 Second commandment | 98 | 15 | 100 | 100 | 15 | 25 |
| B13 Providence | 100 | 10 | 0 | 0 | 0 | 0 |
| B14 Women in the office of elder | 92 | 50 | 80 | 50 | 50 | 50 |
| B15 Canon & apocrypha | 97 | 55 | 55 | 55 | 55 | 50 |
| B16 Consistory meetings | 100 | 15 | 30 | 55 | 30 | 50 |
Scores are 0-100 against the rubric below: 85 and up is reliable, 40-64 is an all-sides answer, below 40 is a refusal, non-answer or error. Reformeer's cells show the lower of its two judges' scores.
Methodology
Built to be fair, transparent and reproducible.
The seven most-googled basic faith questions, plus sixteen harder questions on Reformed distinctives, from the extent of the atonement to the marks of the true church.
Every general model was given the plain question with no added context, exactly as an ordinary person would ask it. Reformeer answered through its normal grounded pipeline.
A separate AI model scored each answer against a reference answer drawn from the Three Forms of Unity and the Church Order, without knowing which system wrote it, rewarding a clear correct answer and penalising hedging.
Because Reformeer is our own system, every one of its answers was re-graded by a second frontier judge from a different lab, instructed to find fault. The lower of the two scores is published. The general models keep the neutral judge's scores.
The questions, the reference answers, the rubric, every transcript, both judges' critiques and every raw score are published under an open licence. Download them and check the work.
Run specification
The scoring rubric
The judge grades doctrinal substance against a reference answer, not prose or length. The four bands:
States the correct answer clearly and accurately, with no hedge that undermines it. A confessional or Scripture citation is a bonus, not a requirement.
Substantially correct but hedged, missing the key distinctive, or softened into “many traditions believe”.
Partially correct or heavily all-sides: the correct answer appears only as one option among several presented as equally valid.
Wrong, refuses, gives a non-answer, or frames the correct position as merely one opinion.
The benchmark was run in English. Reformeer answers in both Afrikaans and English.
Read before citing
CREDO is maintained by Reformeer, and Reformeer is one of the systems under test. The mitigations are structural: the first judge never sees which system produced an answer, a second judge from a different lab re-grades every Reformeer answer adversarially with the lower score published, and every prompt, transcript, critique and score is public for anyone to re-grade.
CREDO does not grade against a neutral average of world religions. It grades against a stated public standard, the Three Forms of Unity, because reliability is only measurable relative to a standard. Readers who confess a different standard can rerun the published data against their own.
General-model scores come from a single blind LLM judge; Reformeer's from the stricter of two. All scores come from a single July 2026 run. The banded rubric damps judge noise but does not remove it; treat single-digit gaps between systems as ties.
General models ran at low reasoning effort with a capped answer length, mirroring a quick everyday question, and the run was in English. Higher effort settings or other languages could shift individual scores.
Dataset
Everything is downloadable: the full run (every transcript, both judges' critiques, every score), the complete task set with reference answers, and the scoring rubric and criteria. Licensed CC BY 4.0. Cite it, audit it, or re-grade it against your own standard.
Cite as
Reformeer (2026). CREDO v1.1: Christian Reformed Evaluation for Doctrinal Orthodoxy. reformeer.org/benchmark
Requests to include another system in the next release are welcome.
FAQ
CREDO (Christian Reformed Evaluation for Doctrinal Orthodoxy) is an open evaluation framework that measures how reliably AI systems answer questions of the Christian faith. It grades answers 0-100 against a fixed public standard, the Three Forms of Unity and the Reformed church order, and publishes every question, transcript, judge critique and raw score under CC BY 4.0. Version 1.1 (July 2026) covers 23 questions, six AI systems and two independent judges.
In CREDO v1.1 Reformeer, the one grounded system in the field, scored 96/100 on theological reliability with no question below 88, well ahead of every mainstream model tested: GPT-5.5 (64), Gemini 3.1 Pro (61), DeepSeek V4 Pro (59), Claude Sonnet 5 (56) and GPT-5 mini (52). The gap is not intelligence but grounding: Reformeer answers from a fixed corpus of the Reformed confessions and church order, while the general models answer from the open internet and tend to hedge.
In the first judging pass it did. But a perfect score from a single judge invites suspicion, and Reformeer is our own system, so v1.1 added an adversarial second judge from a different lab (Claude Fable 5, Anthropic) that re-graded every Reformeer answer, docking loose citations, missing elements of the reference answer and imprecision. It revised 18 of the 23 scores downward, to a published overall of 96 with a per-question range of 88-100. The general models keep the neutral first judge's scores; both judges' critiques for every Reformeer answer are in the downloadable raw data.
With care. On the most basic faith questions the leading models reflexively take an 'all sides' approach, presenting the historic Christian answer as merely one perspective among many. Asked plainly whether God exists, several answered 'no one can really know'. They score far better when you give them explicit context (for example, 'answer consistent with the Nicene Creed and the Reformed confessions'), which is exactly what a purpose-built, grounded tool does for you.
CREDO asks 23 questions: the seven most-googled basic faith questions plus sixteen harder questions on Reformed distinctives. Each answer is scored 0-100 by an independent AI judge, blind to which system wrote the answer, against a reference answer drawn from the Three Forms of Unity (the Belgic Confession, Heidelberg Catechism and Canons of Dort) and the Church Order. Reformeer's answers are additionally re-graded by an adversarial second judge from a different lab, with the lower score published. Every model is asked the raw question with no added context, exactly as an ordinary member would. The full questions, reference answers, rubric and raw results are published for anyone to check.
Large language models are aligned toward a neutral, 'all-sides' voice on contested topics, and they draw on the statistical average of the open internet rather than any confessional standard. The result is fluent hedging: the orthodox answer appears, but only as one option among Muslim, secular and other framings presented as equally valid. That is helpful for neutrality and unhelpful for a Christian seeking a clear, grounded answer.
The Gospel Coalition's Keller Center ran an independent 2025 benchmark grading seven leading models on seven basic faith questions; every model scored between 40 and 64. The general models in CREDO scored 52-64 on the same kinds of questions, closely corroborating their finding on a newer generation of models. CREDO goes further by adding sixteen confessionally Reformed questions and by testing a grounded, purpose-built system (Reformeer) alongside the general models.
The Three Forms of Unity are the confessional standards of the Reformed churches in the continental tradition: the Belgic Confession (Nederlandse Geloofsbelydenis), the Heidelberg Catechism (Heidelbergse Kategismus) and the Canons of Dort (Dordtse Leerreëls). Together with the Church Order they are the standard CREDO grades theological answers against.
From the maintainers
Reformeer answers from the confessions, the church order and the trusted sources of the Reformed tradition, and cites its source every time. Included for every church member.