AA-Omniscience v1.1

Closed-book knowledge and hallucination measured on 3,000 questions, with published Omniscience points, accuracy, and hallucination rate shown separately

KnowledgeOmniscience score (−100 to 100 points)

Stephen M. Walker II · Co-Founder / CEO · November 14, 2026 · 1 min read

Recent published results

AA-Omniscience Public, 600 examples; not private v1.1: ERNIE 5.5 Flash Preview release

Model configurationScoreHarness and setupSource and date
ERNIE 5.5 Flash Preview (Highest available)Qianfan API preview25.2Gemini 3.1 Flash-Lite judgeBaidu, 2026-11-11; Official results and setup notes; provider-published
BaiduGemini 3.1 Flash-Lite judgeAA-Omniscience Public, 600 examples; not private v1.1Published public-set scoreernie.baidu.com

What does AA-Omniscience v1.1 measure?

AA-Omniscience tests closed-book knowledge and hallucination across 3,000 questions. Artificial Analysis runs one repeat without tools. The benchmark publishes an Omniscience score on a −100 to 100 point scale, plus accuracy and hallucination rate as separate percentages. See the Artificial Analysis methodology for the current evaluation setup.

Accuracy and hallucination rate answer different questions. A higher accuracy score means more correct answers. A lower hallucination rate means fewer hallucinations under the benchmark's grading. Neither metric should be relabeled as the other, and hallucination rate is not a direct measure of abstention.

Current Omniscience points

This current snapshot preserves every published model configuration. The points score is the benchmark's headline metric; it is distinct from its accuracy percentage, the aggregate AA Intelligence Index, and the Klu Index. Missing scores are omitted.

Model configurationScoreCost per task (USD)Time per task (seconds)Observation and source
Claude Fable 5.2 (Max, Default Fallback)66.8$0.219054.12026-11-14; AA Index v5.0.1
Claude Fable 5.2 (Xhigh, Default Fallback)64.8$0.03268.12026-11-14; AA Index v5.0.1
Claude Fable 5.2 (High, Default Fallback)64.0$0.01964.52026-11-14; AA Index v5.0.1
Claude Fable 5.2 (Medium, Default Fallback)63.5$0.01533.82026-11-14; AA Index v5.0.1
Claude Fable 5.2 (Low, Default Fallback)62.9$0.01383.02026-11-14; AA Index v5.0.1
Gemini 4 Carbon (High)53.5$0.1232181.12026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Max, Default Fallback)48.1$0.187482.12026-11-14; AA Index v5.0.1
Gemini 4 Carbon (Medium)46.8$0.012619.82026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Max, Default Fallback)46.3$0.326273.72026-11-14; AA Index v5.0.1
Gemini 4 Hydrogen (Xhigh)46.3$0.1675116.82026-11-14; AA Index v5.0.1
Gemini 4 Argon (High)46.1$0.009113.62026-11-14; AA Index v5.0.1
GPT-6 Astra (High)44.6$0.028013.22026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Xhigh, Default Fallback)44.3$0.090820.32026-11-14; AA Index v5.0.1
Gemini 4 Hydrogen (High)43.7$0.014110.62026-11-14; AA Index v5.0.1
GPT-6 Astra (Xhigh)43.7$0.051827.52026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Xhigh, Default Fallback)43.1$0.01486.42026-11-14; AA Index v5.0.1
GPT-6 Astra (Max)42.4$0.098854.52026-11-14; AA Index v5.0.1
Claude Opus 5.5 (High, Default Fallback)42.4$0.00934.12026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Xhigh)42.4$0.009219.12026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Max)42.0$0.018337.62026-11-14; AA Index v5.0.1
Gemini 4 Hydrogen (Medium)41.9$0.00876.42026-11-14; AA Index v5.0.1
GPT-6 Astra (Medium)41.4$0.01095.02026-11-14; AA Index v5.0.1
Gemini 4 Argon (Medium)41.1$0.0011—2026-11-14; AA Index v5.0.1
GPT-6.1 Sol (High)41.0$0.00499.92026-11-14; AA Index v5.0.1
GPT-6 Astra (Low)40.3$0.00703.02026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Medium)40.2$0.00223.92026-11-14; AA Index v5.0.1
Claude Fable 5.1 (High, Default Fallback)39.9$0.02325.22026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Medium, Default Fallback)39.8$0.00823.62026-11-14; AA Index v5.0.1
Gemini 4 Carbon (Low)39.2$0.00080.92026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Low, Default Fallback)39.0$0.00632.72026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Low)38.0$0.00152.62026-11-14; AA Index v5.0.1
Claude Opus 5 (Max)37.6$0.026712.72026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Medium, Default Fallback)36.4$0.01593.42026-11-14; AA Index v5.0.1
Gemini 4 Hydrogen (Low)36.1$0.00332.32026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Low, Default Fallback)33.9$0.00801.52026-11-14; AA Index v5.0.1
Grok 4.7 (Xhigh)31.2$0.028368.82026-11-14; AA Index v5.0.1
Muse Wonder Full (Max)Muse Code subscription30.6——2026-11-05; AA Index v5.0.1
Claude Sonnet 5.5 (Max, Default Fallback)30.5$0.1518110.12026-11-14; AA Index v5.0.1
Grok 4.7 (High)30.0$0.021647.02026-11-14; AA Index v5.0.1
Kimi K3.1 Pro29.9$0.0429140.62026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Max)29.6$0.0425124.72026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Xhigh)28.9$0.007924.02026-11-14; AA Index v5.0.1
GPT-6.1 Terra (High)27.8$0.00308.92026-11-14; AA Index v5.0.1
Grok 4.7 (Low)27.4$0.010018.42026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Medium)26.6$0.00164.92026-11-14; AA Index v5.0.1
Muse Spark Open (Xhigh)25.8$0.009414.62026-11-14; AA Index v5.0.1
Muse Wonder (Max)Meta Model API and Muse Code25.1$0.047521.42026-11-14; AA Index v5.0.1
Grok 4.6 (Xhigh)24.9$0.014433.52026-11-14; AA Index v5.0.1
Muse Wonder (High)Meta Model API and Muse Code24.5$0.029814.32026-11-14; AA Index v5.0.1
Muse Spark 1.3 (Xhigh)23.8——2026-11-14; AA Index v5.0.1
Gemini 3.8 Flash (Medium)23.7$0.00389.02026-11-14; AA Index v5.0.1
Gemini 3.8 Flash (High)23.3$0.013632.02026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Low)22.9$0.00082.22026-11-14; AA Index v5.0.1
Muse Spark 1.3 (Max)22.4$0.022539.92026-11-14; AA Index v5.0.1
GPT-6 Sol (Max)21.4$0.023621.02026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (Xhigh, Default Fallback)20.6$0.00886.02026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (Low, Default Fallback)20.3$0.00291.92026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (High, Default Fallback)18.7$0.00573.72026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (Medium, Default Fallback)18.6$0.00312.12026-11-14; AA Index v5.0.1
Step 5 Preview16.4$0.014740.72026-11-14; AA Index v5.0.1
Inkling 2 Small16.1$0.001316.52026-11-14; AA Index v5.0.1
Gemini 3.8 Flash (Low)13.0——2026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Max)12.3$0.006047.52026-11-14; AA Index v5.0.1
Qwen3.8 Max (0902)10.5$0.008323.12026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Xhigh)7.8$0.00075.82026-11-14; AA Index v5.0.1
Qwen3.8 2.4T A95B7.8——2026-11-14; AA Index v5.0.1
Muse Ember (Xhigh)7.7$0.00114.72026-11-14; AA Index v5.0.1
Muse Ember (Max)7.4$0.00156.62026-11-14; AA Index v5.0.1
Gemini 3.5 Flash-Lite6.9$0.00294.02026-11-14; AA Index v5.0.1
GLM-5.3 (Max)6.0$0.020561.82026-11-14; AA Index v5.0.1
Tencent Hy45.4$0.0403177.32026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (High)5.3$0.00043.42026-11-14; AA Index v5.0.1
Mistral Large 4 (High)Mistral API and open weights5.1$0.006628.62026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Medium)4.2$0.00032.72026-11-14; AA Index v5.0.1
Nemotron 3 Ultra 550B A55B (Reasoning)3.4$0.00213.82026-11-14; AA Index v5.0.1
Mistral Large 4 (Medium)Mistral API and open weights3.3$0.002813.82026-11-14; AA Index v5.0.1
Beam 1.02.3$0.00164.82026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Low)2.2$0.00032.32026-11-14; AA Index v5.0.1
DeepSeek V4.1 Flash 1017 (Non-reasoning)2.1$0.00010.42026-11-14; AA Index v5.0.1
JT-4.1 Flash 236B A21B2.0——2026-11-14; AA Index v5.0.1
DeepSeek V4.1 Flash 1017 (High)1.5$0.00157.32026-11-14; AA Index v5.0.1
Solar Pro 41.4$0.002625.52026-11-14; AA Index v5.0.1
DeepSeek V4.1 Flash 1017 (Max)0.9$0.00189.12026-11-14; AA Index v5.0.1
GLM-5.3-Flash0.7$0.001668.82026-11-14; AA Index v5.0.1
GLM-5.2 (Max)0.6——2026-11-14; AA Index v5.0.1
Ling 3.1 Flash 1019-0.1$0.0104—2026-11-14; AA Index v5.0.1
Inkling (Xhigh)-1.5$0.018159.12026-11-14; AA Index v5.0.1
Kimi K3 (Low)-1.7$0.00507.02026-11-14; AA Index v5.0.1
Claude 4.5 Haiku (Reasoning)-1.8$0.010719.72026-11-14; AA Index v5.0.1
Command A+-2.7$0.000011.82026-11-14; AA Index v5.0.1
Nemotron 3.5 Super VL-2.9$0.001816.42026-11-14; AA Index v5.0.1
Nanbeige4.3-33B-4.4——2026-11-05; AA Index v5.0.1
MiMo-V2.6-Pro-4.5$0.0056112.82026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Non-reasoning)-5.0$0.00020.22026-11-14; AA Index v5.0.1
K2 Horizon 375B A23B-5.0$0.00009.52026-11-14; AA Index v5.0.1
MiniMax-M3-5.5$0.006146.12026-11-14; AA Index v5.0.1
DeepSeek V4 Pro 0813 (Max)-6.4$0.011836.52026-11-14; AA Index v5.0.1
Qwen3.8 27B (Xhigh)-6.4$0.010584.42026-11-14; AA Index v5.0.1
MiniMax-M3.1-Flash-6.4$0.003237.52026-11-14; AA Index v5.0.1
DeepSeek V4 Pro 0813 (High)-6.5$0.010132.52026-11-14; AA Index v5.0.1
Qwen3.8 27B (Non-reasoning)-7.3$0.00010.62026-11-14; AA Index v5.0.1
Mistral Large 4 PreviewRetired public preview-7.5$0.007133.72026-11-14; AA Index v5.0.1
A.X-K2-8.0——2026-11-13; AA Index v5.0.1
GPT-6 Luna (Max)-8.3$0.002344.42026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Max)-9.3$0.077764.92026-11-14; AA Index v5.0.1
Inkling Small-9.5$0.005143.12026-11-14; AA Index v5.0.1
MiMo-V2.6-Flash-10.8$0.0034274.42026-11-14; AA Index v5.0.1
GLM-5.3 (Low)-11.2$0.00092.72026-11-14; AA Index v5.0.1
Agnes 2.5 Pro Theta-11.2$0.000712.62026-11-14; AA Index v5.0.1
K-EXAONE 2.0-11.5——2026-11-13; AA Index v5.0.1
GPT-5.6 Terra (Xhigh)-11.5——2026-11-14; AA Index v5.0.1
Solar Mini 4-11.6——2026-11-14; AA Index v5.0.1
Qwen3.8-Flash-Next-12.2$0.002061.22026-11-14; AA Index v5.0.1
GPT-5.6 Terra (High)-12.3——2026-11-14; AA Index v5.0.1
Granite 4.2 30B-12.4——2026-11-14; AA Index v5.0.1
GPT-6 Luna (High)-12.8$0.000611.92026-11-14; AA Index v5.0.1
GPT-6 Luna (Xhigh)-13.0$0.000917.72026-11-14; AA Index v5.0.1
GPT-6 Luna (Medium)-13.6$0.00047.52026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Medium)-13.8——2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Low)-15.2——2026-11-14; AA Index v5.0.1
Nemotron 3.5 Lightning-15.7$0.000611.42026-11-14; AA Index v5.0.1
Ling 3.0 Tiny-15.9——2026-11-14; AA Index v5.0.1
Granite 4.2 8B-16.7$0.001155.32026-11-14; AA Index v5.0.1
GPT-5.6 Luna (Max)-17.1$0.010380.82026-11-14; AA Index v5.0.1
GPT-6 Luna (Low)-18.1$0.00023.72026-11-14; AA Index v5.0.1
Granite 4.2 3B-18.3——2026-11-14; AA Index v5.0.1
DeepSeek V4 Pro 0813 (Non-reasoning)-19.1$0.00102.52026-11-14; AA Index v5.0.1
Qwen3.8 27B (Low)-21.5$0.001410.52026-11-14; AA Index v5.0.1
Gemini 3.1 Flash-Lite-24.1$0.00265.72026-11-14; AA Index v5.0.1
GPT-6 Luna (Non-reasoning)-25.8$0.00000.22026-11-14; AA Index v5.0.1
Apodex 1.1-27.9$0.015238.62026-11-14; AA Index v5.0.1
Mistral Small 4 (Reasoning)-31.0$0.00044.72026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Non-reasoning)-31.8——2026-11-14; AA Index v5.0.1
Muse Glimmer (High)-32.2$0.002425.62026-11-14; AA Index v5.0.1
Qwen3.8 27B (Medium)-35.9$0.008062.42026-11-14; AA Index v5.0.1
Ring-2.6-1T-36.0——2026-11-14; AA Index v5.0.1
Mistral Medium 3.5-38.7$0.013812.52026-11-14; AA Index v5.0.1
gpt-oss-120b (High)-46.4$0.002726.72026-11-14; AA Index v5.0.1
Gemma 4 31B (Reasoning)-48.5——2026-11-14; AA Index v5.0.1
North Mini Code-49.8$0.000032.52026-11-14; AA Index v5.0.1
Solar Pro 3-53.7——2026-11-14; AA Index v5.0.1
NVIDIA Nemotron 3 Nano 4B-71.2——2026-11-14; AA Index v5.0.1
Artificial AnalysisNo tools, 1 repeatAA-Omniscience v1.1, 3,000 questionsOmniscience score (−100 to 100 points)artificialanalysis.ai

Accuracy

Higher is better. AA Intelligence Index v5 assigns accuracy a 10% weight.

Model configurationScoreObservation and source
Claude Fable 5.2 (Max, Default Fallback)79.1%2026-11-14; AA Index v5.0.1
Claude Fable 5.2 (Xhigh, Default Fallback)78.0%2026-11-14; AA Index v5.0.1
Claude Fable 5.2 (High, Default Fallback)77.2%2026-11-14; AA Index v5.0.1
Claude Fable 5.2 (Medium, Default Fallback)77.0%2026-11-14; AA Index v5.0.1
Claude Fable 5.2 (Low, Default Fallback)76.3%2026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Max, Default Fallback)68.4%2026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Xhigh, Default Fallback)67.2%2026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Xhigh, Default Fallback)65.5%2026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Max, Default Fallback)65.5%2026-11-14; AA Index v5.0.1
Claude Opus 5.5 (High, Default Fallback)64.8%2026-11-14; AA Index v5.0.1
Claude Fable 5.1 (High, Default Fallback)64.7%2026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Medium, Default Fallback)63.9%2026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Low, Default Fallback)63.3%2026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Medium, Default Fallback)62.6%2026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Max)61.8%2026-11-14; AA Index v5.0.1
GPT-6 Astra (Max)61.6%2026-11-14; AA Index v5.0.1
GPT-6 Astra (High)61.1%2026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Xhigh)61.1%2026-11-14; AA Index v5.0.1
GPT-6 Astra (Xhigh)61.0%2026-11-14; AA Index v5.0.1
Claude Opus 5 (Max)60.9%2026-11-14; AA Index v5.0.1
GPT-6.1 Sol (High)60.4%2026-11-14; AA Index v5.0.1
GPT-6 Astra (Medium)59.6%2026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Medium)59.6%2026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Low, Default Fallback)58.7%2026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Low)58.6%2026-11-14; AA Index v5.0.1
GPT-6 Astra (Low)58.6%2026-11-14; AA Index v5.0.1
Gemini 4 Carbon (High)58.3%2026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (Max, Default Fallback)51.5%2026-11-14; AA Index v5.0.1
GPT-6 Sol (Max)51.1%2026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (Xhigh, Default Fallback)50.9%2026-11-14; AA Index v5.0.1
Gemini 3.8 Flash (High)50.5%2026-11-14; AA Index v5.0.1
Gemini 4 Hydrogen (Xhigh)50.5%2026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (High, Default Fallback)50.3%2026-11-14; AA Index v5.0.1
Tencent Hy450.0%2026-11-14; AA Index v5.0.1
Gemini 3.8 Flash (Medium)49.6%2026-11-14; AA Index v5.0.1
Gemini 4 Carbon (Low)49.2%2026-11-14; AA Index v5.0.1
Gemini 4 Argon (Medium)49.0%2026-11-14; AA Index v5.0.1
Gemini 4 Carbon (Medium)48.9%2026-11-14; AA Index v5.0.1
Kimi K3.1 Pro48.9%2026-11-14; AA Index v5.0.1
Gemini 4 Hydrogen (Medium)48.3%2026-11-14; AA Index v5.0.1
Gemini 4 Argon (High)48.3%2026-11-14; AA Index v5.0.1
Gemini 3.8 Flash (Low)48.3%2026-11-14; AA Index v5.0.1
Gemini 4 Hydrogen (High)48.2%2026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Xhigh)48.0%2026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Max)47.6%2026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Medium)47.4%2026-11-14; AA Index v5.0.1
GPT-6.1 Terra (High)47.3%2026-11-14; AA Index v5.0.1
Gemini 4 Hydrogen (Low)46.2%2026-11-14; AA Index v5.0.1
Grok 4.6 (Xhigh)46.2%2026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (Low, Default Fallback)46.0%2026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (Medium, Default Fallback)45.8%2026-11-14; AA Index v5.0.1
Grok 4.7 (Low)45.7%2026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Low)45.6%2026-11-14; AA Index v5.0.1
DeepSeek V4 Pro 0813 (Max)45.2%2026-11-14; AA Index v5.0.1
DeepSeek V4 Pro 0813 (High)45.1%2026-11-14; AA Index v5.0.1
MiniMax-M3.1-Flash45.1%2026-11-14; AA Index v5.0.1
MiniMax-M344.9%2026-11-14; AA Index v5.0.1
Grok 4.7 (Xhigh)42.7%2026-11-14; AA Index v5.0.1
Kimi K3 (Low)42.4%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Max)42.3%2026-11-14; AA Index v5.0.1
Muse Spark Open (Xhigh)42.0%2026-11-14; AA Index v5.0.1
Grok 4.7 (High)41.8%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Xhigh)41.3%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (High)41.2%2026-11-14; AA Index v5.0.1
Muse Wonder Full (Max)Muse Code subscription41.0%2026-11-05; AA Index v5.0.1
GPT-6.1 Terra (Non-reasoning)40.7%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Medium)40.5%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Low)39.8%2026-11-14; AA Index v5.0.1
GPT-6 Luna (Max)39.6%2026-11-14; AA Index v5.0.1
DeepSeek V4.1 Flash 1017 (Max)39.6%2026-11-14; AA Index v5.0.1
Inkling (Xhigh)39.3%2026-11-14; AA Index v5.0.1
GPT-5.6 Luna (Max)39.1%2026-11-14; AA Index v5.0.1
GPT-6 Luna (High)39.0%2026-11-14; AA Index v5.0.1
DeepSeek V4.1 Flash 1017 (High)38.9%2026-11-14; AA Index v5.0.1
GPT-6 Luna (Medium)38.7%2026-11-14; AA Index v5.0.1
DeepSeek V4 Pro 0813 (Non-reasoning)38.6%2026-11-14; AA Index v5.0.1
GPT-6 Luna (Xhigh)38.6%2026-11-14; AA Index v5.0.1
Muse Wonder (High)Meta Model API and Muse Code38.2%2026-11-14; AA Index v5.0.1
Muse Wonder (Max)Meta Model API and Muse Code38.0%2026-11-14; AA Index v5.0.1
Muse Spark 1.3 (Max)38.0%2026-11-14; AA Index v5.0.1
Ling 3.0 Tiny37.9%2026-11-14; AA Index v5.0.1
JT-4.1 Flash 236B A21B37.9%2026-11-14; AA Index v5.0.1
Muse Spark 1.3 (Xhigh)37.8%2026-11-14; AA Index v5.0.1
Step 5 Preview36.4%2026-11-14; AA Index v5.0.1
GPT-6 Luna (Low)36.1%2026-11-14; AA Index v5.0.1
MiMo-V2.6-Pro34.8%2026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Max)34.7%2026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Xhigh)33.8%2026-11-14; AA Index v5.0.1
Inkling 2 Small33.8%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Non-reasoning)32.6%2026-11-14; AA Index v5.0.1
GLM-5.3 (Max)32.3%2026-11-14; AA Index v5.0.1
GLM-5.3 (Low)31.9%2026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (High)31.8%2026-11-14; AA Index v5.0.1
Inkling Small31.8%2026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Medium)31.7%2026-11-14; AA Index v5.0.1
Gemini 3.1 Flash-Lite31.7%2026-11-14; AA Index v5.0.1
Qwen3.8 2.4T A95B31.4%2026-11-14; AA Index v5.0.1
Beam 1.030.7%2026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Low)30.4%2026-11-14; AA Index v5.0.1
GPT-6 Luna (Non-reasoning)30.1%2026-11-14; AA Index v5.0.1
Qwen3.8 Max (0902)29.5%2026-11-14; AA Index v5.0.1
GLM-5.3-Flash28.2%2026-11-14; AA Index v5.0.1
Apodex 1.128.2%2026-11-14; AA Index v5.0.1
Muse Glimmer (High)28.0%2026-11-14; AA Index v5.0.1
MiMo-V2.6-Flash27.2%2026-11-14; AA Index v5.0.1
Ling 3.1 Flash 101926.5%2026-11-14; AA Index v5.0.1
Gemini 3.5 Flash-Lite26.5%2026-11-14; AA Index v5.0.1
Ring-2.6-1T26.3%2026-11-14; AA Index v5.0.1
Mistral Large 4 (High)Mistral API and open weights26.0%2026-11-14; AA Index v5.0.1
Mistral Large 4 PreviewRetired public preview23.9%2026-11-14; AA Index v5.0.1
Qwen3.8-Flash-Next23.5%2026-11-14; AA Index v5.0.1
Mistral Medium 3.523.0%2026-11-14; AA Index v5.0.1
Mistral Large 4 (Medium)Mistral API and open weights22.5%2026-11-14; AA Index v5.0.1
DeepSeek V4.1 Flash 1017 (Non-reasoning)21.9%2026-11-14; AA Index v5.0.1
gpt-oss-120b (High)21.7%2026-11-14; AA Index v5.0.1
Mistral Small 4 (Reasoning)21.4%2026-11-14; AA Index v5.0.1
Muse Ember (Xhigh)21.4%2026-11-14; AA Index v5.0.1
Agnes 2.5 Pro Theta21.3%2026-11-14; AA Index v5.0.1
Nemotron 3 Ultra 550B A55B (Reasoning)21.2%2026-11-14; AA Index v5.0.1
Nemotron 3.5 Super VL21.2%2026-11-14; AA Index v5.0.1
GLM-5.2 (Max)21.1%2026-11-14; AA Index v5.0.1
Muse Ember (Max)21.1%2026-11-14; AA Index v5.0.1
Gemma 4 31B (Reasoning)19.9%2026-11-14; AA Index v5.0.1
K2 Horizon 375B A23B18.6%2026-11-14; AA Index v5.0.1
Solar Pro 418.4%2026-11-14; AA Index v5.0.1
North Mini Code18.4%2026-11-14; AA Index v5.0.1
Qwen3.8 27B (Low)18.3%2026-11-14; AA Index v5.0.1
Solar Mini 418.2%2026-11-14; AA Index v5.0.1
Qwen3.8 27B (Medium)17.9%2026-11-14; AA Index v5.0.1
Claude 4.5 Haiku (Reasoning)17.5%2026-11-14; AA Index v5.0.1
Solar Pro 317.5%2026-11-14; AA Index v5.0.1
A.X-K217.5%2026-11-13; AA Index v5.0.1
Qwen3.8 27B (Xhigh)17.3%2026-11-14; AA Index v5.0.1
Nemotron 3.5 Lightning14.7%2026-11-14; AA Index v5.0.1
K-EXAONE 2.014.5%2026-11-13; AA Index v5.0.1
Granite 4.2 8B11.8%2026-11-14; AA Index v5.0.1
Nanbeige4.3-33B11.7%2026-11-05; AA Index v5.0.1
Granite 4.2 30B11.2%2026-11-14; AA Index v5.0.1
Command A+9.8%2026-11-14; AA Index v5.0.1
NVIDIA Nemotron 3 Nano 4B9.5%2026-11-14; AA Index v5.0.1
Granite 4.2 3B9.2%2026-11-14; AA Index v5.0.1
Qwen3.8 27B (Non-reasoning)9.1%2026-11-14; AA Index v5.0.1
Artificial AnalysisNo tools, 1 repeatAA-Omniscience v1.1, 3,000 questionsAccuracyartificialanalysis.ai

Hallucination rate

Lower is better. AA Intelligence Index v5 assigns a separate 5% weight to one minus the hallucination rate, so this table retains the published rate and its original direction.

Model configurationScoreObservation and source
Gemini 4 Carbon (Medium)4.2%2026-11-14; AA Index v5.0.1
Gemini 4 Argon (High)4.3%2026-11-14; AA Index v5.0.1
Gemini 4 Hydrogen (Xhigh)8.5%2026-11-14; AA Index v5.0.1
Gemini 4 Hydrogen (High)8.7%2026-11-14; AA Index v5.0.1
Gemini 4 Carbon (High)11.4%2026-11-14; AA Index v5.0.1
Gemini 4 Hydrogen (Medium)12.5%2026-11-14; AA Index v5.0.1
Command A+13.9%2026-11-14; AA Index v5.0.1
Gemini 4 Argon (Medium)15.4%2026-11-14; AA Index v5.0.1
Muse Ember (Xhigh)17.3%2026-11-14; AA Index v5.0.1
Muse Ember (Max)17.4%2026-11-14; AA Index v5.0.1
Muse Wonder Full (Max)Muse Code subscription17.6%2026-11-05; AA Index v5.0.1
Qwen3.8 27B (Non-reasoning)18.0%2026-11-14; AA Index v5.0.1
Nanbeige4.3-33B18.2%2026-11-05; AA Index v5.0.1
Gemini 4 Hydrogen (Low)18.8%2026-11-14; AA Index v5.0.1
Gemini 4 Carbon (Low)19.8%2026-11-14; AA Index v5.0.1
Grok 4.7 (Xhigh)20.0%2026-11-14; AA Index v5.0.1
Grok 4.7 (High)20.2%2026-11-14; AA Index v5.0.1
Muse Wonder (Max)Meta Model API and Muse Code20.9%2026-11-14; AA Index v5.0.1
Solar Pro 420.9%2026-11-14; AA Index v5.0.1
Muse Wonder (High)Meta Model API and Muse Code22.2%2026-11-14; AA Index v5.0.1
Muse Spark 1.3 (Xhigh)22.5%2026-11-14; AA Index v5.0.1
Nemotron 3 Ultra 550B A55B (Reasoning)22.6%2026-11-14; AA Index v5.0.1
Claude 4.5 Haiku (Reasoning)23.4%2026-11-14; AA Index v5.0.1
Mistral Large 4 (Medium)Mistral API and open weights24.8%2026-11-14; AA Index v5.0.1
Muse Spark 1.3 (Max)25.2%2026-11-14; AA Index v5.0.1
DeepSeek V4.1 Flash 1017 (Non-reasoning)25.3%2026-11-14; AA Index v5.0.1
GLM-5.2 (Max)25.9%2026-11-14; AA Index v5.0.1
Granite 4.2 30B26.7%2026-11-14; AA Index v5.0.1
Inkling 2 Small26.7%2026-11-14; AA Index v5.0.1
Gemini 3.5 Flash-Lite26.7%2026-11-14; AA Index v5.0.1
Qwen3.8 Max (0902)27.1%2026-11-14; AA Index v5.0.1
Muse Spark Open (Xhigh)28.0%2026-11-14; AA Index v5.0.1
Mistral Large 4 (High)Mistral API and open weights28.2%2026-11-14; AA Index v5.0.1
Qwen3.8 27B (Xhigh)28.6%2026-11-14; AA Index v5.0.1
K2 Horizon 375B A23B29.0%2026-11-14; AA Index v5.0.1
Granite 4.2 3B30.3%2026-11-14; AA Index v5.0.1
K-EXAONE 2.030.4%2026-11-13; AA Index v5.0.1
Nemotron 3.5 Super VL30.5%2026-11-14; AA Index v5.0.1
A.X-K230.9%2026-11-13; AA Index v5.0.1
Step 5 Preview31.3%2026-11-14; AA Index v5.0.1
Granite 4.2 8B32.2%2026-11-14; AA Index v5.0.1
Grok 4.7 (Low)33.8%2026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Max)34.2%2026-11-14; AA Index v5.0.1
Qwen3.8 2.4T A95B34.5%2026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Max)34.5%2026-11-14; AA Index v5.0.1
Nemotron 3.5 Lightning35.7%2026-11-14; AA Index v5.0.1
Ling 3.1 Flash 101936.3%2026-11-14; AA Index v5.0.1
Solar Mini 436.5%2026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Xhigh)36.8%2026-11-14; AA Index v5.0.1
GPT-6.1 Terra (High)37.0%2026-11-14; AA Index v5.0.1
Kimi K3.1 Pro37.3%2026-11-14; AA Index v5.0.1
GLM-5.3-Flash38.3%2026-11-14; AA Index v5.0.1
GLM-5.3 (Max)38.9%2026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (High)38.9%2026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Xhigh)39.2%2026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Medium)39.6%2026-11-14; AA Index v5.0.1
Grok 4.6 (Xhigh)39.7%2026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Medium)40.4%2026-11-14; AA Index v5.0.1
Claude Haiku 5.5 (Low)40.5%2026-11-14; AA Index v5.0.1
Beam 1.041.0%2026-11-14; AA Index v5.0.1
Mistral Large 4 PreviewRetired public preview41.3%2026-11-14; AA Index v5.0.1
Agnes 2.5 Pro Theta41.4%2026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Low)41.6%2026-11-14; AA Index v5.0.1
GPT-6 Astra (High)42.5%2026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (Max, Default Fallback)43.3%2026-11-14; AA Index v5.0.1
GPT-6 Astra (Low)44.2%2026-11-14; AA Index v5.0.1
GPT-6 Astra (Xhigh)44.6%2026-11-14; AA Index v5.0.1
GPT-6 Astra (Medium)45.2%2026-11-14; AA Index v5.0.1
Qwen3.8-Flash-Next46.8%2026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (Low, Default Fallback)47.7%2026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Xhigh)48.0%2026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Medium)48.1%2026-11-14; AA Index v5.0.1
Qwen3.8 27B (Low)48.7%2026-11-14; AA Index v5.0.1
GPT-6.1 Sol (High)49.0%2026-11-14; AA Index v5.0.1
GPT-6 Astra (Max)49.8%2026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Low)49.9%2026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (Medium, Default Fallback)50.0%2026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Max, Default Fallback)50.3%2026-11-14; AA Index v5.0.1
Gemini 3.8 Flash (Medium)51.5%2026-11-14; AA Index v5.0.1
GPT-6.1 Sol (Max)51.9%2026-11-14; AA Index v5.0.1
MiMo-V2.6-Flash52.2%2026-11-14; AA Index v5.0.1
Gemini 3.8 Flash (High)55.1%2026-11-14; AA Index v5.0.1
Claude Fable 5.2 (Low, Default Fallback)56.4%2026-11-14; AA Index v5.0.1
JT-4.1 Flash 236B A21B57.9%2026-11-14; AA Index v5.0.1
Claude Fable 5.2 (High, Default Fallback)58.0%2026-11-14; AA Index v5.0.1
Claude Fable 5.2 (Medium, Default Fallback)58.5%2026-11-14; AA Index v5.0.1
Claude Fable 5.2 (Max, Default Fallback)59.3%2026-11-14; AA Index v5.0.1
Claude Opus 5 (Max)59.4%2026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Low, Default Fallback)59.8%2026-11-14; AA Index v5.0.1
MiMo-V2.6-Pro60.2%2026-11-14; AA Index v5.0.1
Claude Fable 5.2 (Xhigh, Default Fallback)60.4%2026-11-14; AA Index v5.0.1
Inkling Small60.5%2026-11-14; AA Index v5.0.1
GPT-6 Sol (Max)60.8%2026-11-14; AA Index v5.0.1
DeepSeek V4.1 Flash 1017 (High)61.2%2026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (Xhigh, Default Fallback)61.7%2026-11-14; AA Index v5.0.1
GLM-5.3 (Low)63.2%2026-11-14; AA Index v5.0.1
Claude Sonnet 5.5 (High, Default Fallback)63.6%2026-11-14; AA Index v5.0.1
Claude Opus 5.5 (High, Default Fallback)63.9%2026-11-14; AA Index v5.0.1
DeepSeek V4.1 Flash 1017 (Max)64.1%2026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Xhigh, Default Fallback)65.0%2026-11-14; AA Index v5.0.1
Qwen3.8 27B (Medium)65.4%2026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Low, Default Fallback)66.3%2026-11-14; AA Index v5.0.1
Mistral Small 4 (Reasoning)66.6%2026-11-14; AA Index v5.0.1
Claude Opus 5.5 (Medium, Default Fallback)66.9%2026-11-14; AA Index v5.0.1
Inkling (Xhigh)67.2%2026-11-14; AA Index v5.0.1
Gemini 3.8 Flash (Low)68.1%2026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Xhigh, Default Fallback)69.5%2026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Medium, Default Fallback)69.8%2026-11-14; AA Index v5.0.1
Claude Fable 5.1 (Max, Default Fallback)70.0%2026-11-14; AA Index v5.0.1
Claude Fable 5.1 (High, Default Fallback)70.2%2026-11-14; AA Index v5.0.1
Kimi K3 (Low)76.6%2026-11-14; AA Index v5.0.1
GPT-6.1 Terra (Non-reasoning)77.1%2026-11-14; AA Index v5.0.1
Apodex 1.178.0%2026-11-14; AA Index v5.0.1
GPT-6 Luna (Max)79.3%2026-11-14; AA Index v5.0.1
GPT-6 Luna (Non-reasoning)80.0%2026-11-14; AA Index v5.0.1
Mistral Medium 3.580.2%2026-11-14; AA Index v5.0.1
Gemini 3.1 Flash-Lite81.7%2026-11-14; AA Index v5.0.1
North Mini Code83.5%2026-11-14; AA Index v5.0.1
Muse Glimmer (High)83.6%2026-11-14; AA Index v5.0.1
GPT-6 Luna (Xhigh)84.0%2026-11-14; AA Index v5.0.1
Ring-2.6-1T84.6%2026-11-14; AA Index v5.0.1
GPT-6 Luna (Low)84.8%2026-11-14; AA Index v5.0.1
GPT-6 Luna (High)84.9%2026-11-14; AA Index v5.0.1
GPT-6 Luna (Medium)85.3%2026-11-14; AA Index v5.0.1
Gemma 4 31B (Reasoning)85.5%2026-11-14; AA Index v5.0.1
Solar Pro 386.4%2026-11-14; AA Index v5.0.1
Ling 3.0 Tiny86.7%2026-11-14; AA Index v5.0.1
gpt-oss-120b (High)86.9%2026-11-14; AA Index v5.0.1
NVIDIA Nemotron 3 Nano 4B89.1%2026-11-14; AA Index v5.0.1
Tencent Hy489.1%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Max)89.4%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Xhigh)90.1%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (High)91.0%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Medium)91.3%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Low)91.3%2026-11-14; AA Index v5.0.1
MiniMax-M391.4%2026-11-14; AA Index v5.0.1
GPT-5.6 Luna (Max)92.3%2026-11-14; AA Index v5.0.1
MiniMax-M3.1-Flash93.7%2026-11-14; AA Index v5.0.1
DeepSeek V4 Pro 0813 (Non-reasoning)93.9%2026-11-14; AA Index v5.0.1
DeepSeek V4 Pro 0813 (Max)94.1%2026-11-14; AA Index v5.0.1
DeepSeek V4 Pro 0813 (High)94.1%2026-11-14; AA Index v5.0.1
GPT-5.6 Terra (Non-reasoning)95.6%2026-11-14; AA Index v5.0.1
Artificial AnalysisNo tools, 1 repeatAA-Omniscience v1.1, 3,000 questionsHallucination rate; lower is betterartificialanalysis.ai

Version and comparison boundaries

These boards cover v1.1 and its published AA model observations. Do not merge earlier Omniscience results into this series or infer improvement from an older version without verifying that the question set, prompts, and grading match. Any cost and time columns come from this benchmark's observation; whole-index evaluation costs are not attributed to Omniscience.