AA-Omniscience

Knowledge benchmark developed by artificial-analysis for evaluating AI models' breadth and depth of knowledge across domains. claude-fable 5's performance jump on this benchmark led evaluators to infer it may be significantly larger than previous public anthropic models.

Performance Analysis

Claude Fable 5 Results

• Significant performance jump compared to previous anthropic models
• Performance level suggests substantial model scaling
• Led to inference about larger model size than prior public releases

Size Inference

artificial-analysis noted that the knowledge benchmark jump could indicate:

• Larger model parameters than previous public anthropic models
• Increased training data or knowledge representation
• Enhanced knowledge synthesis capabilities

Evaluation Focus

AA-Omniscience appears to assess:

• Breadth of knowledge across domains
• Depth of understanding in specialized areas
• Knowledge synthesis and connection-making
• Factual accuracy and recall

Methodology Note

The size inference is described as "inference rather than confirmed spec," indicating:

• Performance-based estimation rather than confirmed parameters
• Analysis based on capability patterns rather than technical disclosure
• Comparative assessment against known model characteristics

See also

• artificial-analysis
• claude-fable
• mythos-class-models
• knowledge-benchmarks