Mmlu

• Argilla Notus 7B v1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Baichuan2 13B Chat on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Baichuan2 7B Chat on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Capybara 1.5B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Chat Bison on MMLU (Massive Multitask Language Understanding): Score Breakdown
• ChatGLM3 6B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 2.1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Haiku (2024-03-07) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Haiku on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Opus (2024-02-29) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Opus on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Sonnet (2024-02-29) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3 Sonnet on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3.5 Haiku on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3.5 Sonnet (2024-10-22) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude 3.5 Sonnet on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Claude Instant 1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Code Bison on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Code Llama 13B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Code Llama 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Code Llama 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Code Llama 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Codestral Mamba on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Codestral on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command Light on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command Nightly on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command R (08-2024) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command R on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command R+ (08-2024) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command R+ on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Command R7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DBRX Base on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DBRX Instruct on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek Coder 33B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek Coder 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek Coder V2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek LLM 67B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek Math 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek V2 Chat on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek V2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• DeepSeek V3 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Embed English v3 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Falcon 180B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Falcon 40B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Flan-T5 XL on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Flan-T5 XXL on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Flan-UL2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.0 Flash on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.0 Pro on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.0 Ultra on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.5 Flash 002 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.5 Flash on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.5 Flash-8B 002 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.5 Flash-8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.5 Pro 002 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 1.5 Pro on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 2.0 Flash on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemini 2.0 Flash Thinking on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemma 2 27B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemma 2 9B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemma 2B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Gemma 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GLM-4 9B Chat on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GLM-4 Air on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GLM-4 Flash on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GLM-4 Plus on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GLM-4V 9B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-3.5 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-3.5 Turbo 16K on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-3.5 Turbo on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 0125 Preview on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 1106 Preview on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 32K on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 Turbo on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4 Vision Preview on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4o (2024-05-13) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4o (2024-08-06) on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4o mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• GPT-4o on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Grok Beta on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Grok Vision Beta on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Grok-2 Mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Grok-2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Grok-2 Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Hermes 3 Llama 3.1 405B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Hermes 3 Llama 3.1 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Hermes 3 Llama 3.1 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jamba 1.5 Large on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jamba 1.5 Mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jamba 1.5 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jamba Instruct on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jurassic-2 Mid on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Jurassic-2 Ultra on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 2 13B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 2 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 2 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.1 405B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.1 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.1 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.1 Nemotron 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.2 11B Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.2 1B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.2 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.2 90B Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama 3.3 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama Guard 2 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llama Guard 3 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Llemma 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mathstral 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Microsoft WizardCoder Python 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Microsoft WizardLM 2 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Microsoft WizardLM 2 8x22B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Microsoft WizardMath 7B v1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Ministral 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Ministral 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral 7B v0.1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral 7B v0.2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral 7B v0.3 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Large 2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Large on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Medium on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Nemo on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Small 3 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Small on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mistral Tiny on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mixtral 8x22B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Mixtral 8x7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• MPT 30B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• MPT 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Nous Capybara 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Nous Capybara 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Nous Hermes 2 Mixtral 8x7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Nous Hermes 2 Solar 10.7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Nous Hermes 2 Yi 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• NVIDIA Llama 3.1 Nemotron 70B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• o1 mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• o1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• o1 Preview on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OLMo 1.7 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OLMo 2 1124 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OLMo 7B Instruct on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OLMo 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OLMo 7B SFT on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Open-Platypus on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OpenChat 3.5 1210 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• OpenChat 3.6 8B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Orca 2 13B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• PaLM 2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-1.5 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-2 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3 Medium on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3 Mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3 Small on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3 Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3.5 Mini on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-3.5 MoE on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Phi-4 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen1.5 110B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen1.5 14B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen1.5 32B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen1.5 72B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2 1.5B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2 57B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2 72B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 0.5B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 1.5B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 14B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 32B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 72B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Qwen2.5 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Sonar Huge on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Sonar Large on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Sonar Reasoning on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Sonar Small on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StableCode 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StableLM 2 1.6B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StableLM 2 12B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StableLM 3 4B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StableLM Zephyr 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StarChat2 15B v0.1 on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StarCoder2 15B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StarCoder2 3B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• StarCoder2 7B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Text Bison on MMLU (Massive Multitask Language Understanding): Score Breakdown
• TigerBot 70B Chat on MMLU (Massive Multitask Language Understanding): Score Breakdown
• WizardLM Team WizardLM 2 8x22B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi 1.5 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi 1.5 6B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi 1.5 9B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi 34B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi 6B on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi Large on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi Large Turbo on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Yi Vision on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Zephyr 7B Alpha on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Zephyr 7B Beta on MMLU (Massive Multitask Language Understanding): Score Breakdown
• Zephyr ORPO 141B Alpha on MMLU (Massive Multitask Language Understanding): Score Breakdown