Model Comparison

Select models to compare side-by-side, or set filters to narrow

PropertyDeepSeek-R1Llama 3 70BQwen 2.5 72B
ProviderDeepSeekMetaAlibaba Cloud
Parameters671B (37B active)70B72B
ArchitectureMoEDense TransformerDense Transformer
Context Window128K8K128K
LicenseMITLlama 3 CommunityApache 2.0 (Qwen License)
Released2025-01-202024-04-182024-09-19
MMLU90.8%82%85.4%
HumanEval92.4%81.7%82.4%
GSM8K97.3%93%95.2%
TruthfulQA79.2%62.3%65.8%
IFEval--87.2%
Rating

Personal Notes

DeepSeek-R1
Llama 3 70B
Qwen 2.5 72B