Compare AI Chat models
| Model | Output Speed (Token/sec) | Artificial Analysis Quality Index | Reasoning & Knowledge (MMLU) | Scientific Reasoning & Knowledge (GPQA) | Quantitative Reasoning (MATH) | Coding (HumanEval) |
|---|---|---|---|---|---|---|
 ChatGPT 4.1 Mini | 145 | 71.4 | 82 | 43 | 75 | 86 |
| ChatGPT 4.1 | 95 | 77 | 89 | 51 | 78 | 90 |
| ChatGPT v4 Plus | 95 | 77 | 89 | 51 | 78 | 90 |
| ChatGPT o4 Mini | 199 | 89 | 86 | 75 | - | 97 |
| ChatGPT o1 | 10 | 86 | 91 | 67 | 92 | 96 |
 Claude V3.5 Haiku | 64 | 69 | 81 | 37 | 73 | 85 |
| Claude V3.5 Sonnet | 59 | 80 | 89 | 58 | 79 | 93 |
| Claude V3.7 Sonnet | - | - | - | - | - | - |
 xAI Grok 2 | - | - | - | - | - | - |
 DeepSeek-V3 | 12 | 79 | 87 | 53 | 86 | 91 |
| DeepSeek-R1 | 27 | 89 | 91 | 70 | 97 | 98 |
 Gemini 2.0 Flash | 160 | 83 | 88 | 62 | 93 | 90 |
| Gemini 2.0 Flash Thinking | - | - | - | - | - | - |
| Gemini 2.5 Pro | 135 | 85 | - | - | - | - |
 Jamba 1.5 Large | 57 | 64 | 80 | 41 | 60 | 74 |
 Llama 3.2 11B | 117 | 54 | 72 | 26 | 50 | 67 |
| Llama 3.2 90B | 40 | 66 | 83 | 43 | 61 | 75 |
| Llama 3.3 70B | 72 | 74 | 86 | 49 | 76 | 86 |
 Mistral Large 2 | 37 | 73 | 85 | 48 | 72 | 87 |
| Codestral 25.01 | 213 | 45 | 4.5 | 31 | 61 | 85 |
 GLM4V Flash | - | - | - | - | - | - |
| GLM4 4 Plus | - | - | - | - | - | - |
 Nova Pro | 95 | 75 | 84 | 48 | 79 | 88 |