The Trust Layer for AI

Validate, secure, and benchmark AI systems before they reach production. Turn model behavior into measurable confidence.

>pip install openvals

EvaluateBenchmarkValidateTrust

Factuality
Safety & Reliability
Model Comparison
http://prod.openvalidations.com
OpenVals Executive Dashboard: maturity score, capability scores, and current vs target charts
200,000+
Experiments run
53
LLM providers
20+
Core metrics
v0.5.5
Current release
Dr. Pinnacle
License
Independent Evaluation, Unbiased Benchmarks

AI Models, Rigorously Tested.

We benchmark the world's leading AI models on economically valuable tasks such as finance, software, and frontier risk like cybersecurity, recursive self improvement and mental health. We run all of our own evaluations and create many of our benchmarks in-house.

OPENVALS INDEX
•NOV 18, 2026
1–8 of 23
100.0%
DEEPSCALER1.5B
100.0%
GEMMA 3NE2B
98.3%
HUNYUAN1.8B
96.7%
GRANITE 3.32.0B
96.7%
QWEN 30.6B
91.4%
TERNARYBONSAI 1.7B
90.8%
LFM 2.5THINKING
90.2%
MEDPSY1.7B
89.7%
SMOLLM1.7B
88.1%
OPENCHAT7B
86.6%
MINISTRAL3.0B
83.4%
PHI-33.8B
80.5%
LLAMA 2.01.0B
80.4%
HERMES 33.0B
78.3%
STABLELMZEPHYR 3B
77.5%
FALCON 31.0B
73.3%
YI-CODER1.5B
69.6%
DEEPSEEKR1-QWEN 1.5B
47.2%
ONELLMDOEY 1.0B
37.7%
BLOOM560M
37.3%
SUPRA50M
19.7%
ASENAESP32 121M
12.4%
WILLOWALPHA 0.3B
iShowing all 23 models (1–8 in view)
Swipe or use arrows to view all 23 models →View Full Results

Latest Reports

Recent benchmark releases and model evaluations across open-weight and enterprise AI.

Validated Model Registry (491)

ModelsPerformanceTrustRankings
AccuracySemanticLatencyFactualityHallucinationSafetyReliabilityDRS
LiquidAI/lfm2.5-350m:q4_k_m350m320 MB
61.3%
61.3%1 ms277080.0%77.9%49.2%100.0%93.6%1/491
lfm3-omni:2b2b2.0 GB
75.0%
63.6%3244 ms70.9%38.5%96.2%100.0%70.2%2/491
qwen2.5vl:3b3b3.2 GB
70.2%
64.2%2624 ms71.3%37.5%100.0%100.0%70.1%3/491
granite3.2-vision:2b2b2.4 GB
62.6%
66.3%6199 ms73.1%36.8%100.0%100.0%68.7%4/491
blueishai/anant-base:q41.8b1.12 GB
89.7%
76.8%971 ms66.5%49.1%100.0%87.6%67.2%5/491
Qwen 2.5 0.5B490M
57.6%
100.0%3580 ms35.6%20.5%200.0%33.3%65.0%6/491
LiquidAI2b1.2 GB
73.0%
63.8%1806 ms71.1%49.8%100.0%94.4%64.8%7/491
granite3.1-dense:2b2.5b1.6 GB
81.6%
69.5%6448 ms75.6%52.3%100.0%90.3%64.8%8/491
moondream1.8b1.7 GB
61.9%
53.1%6624 ms60.5%41.8%100.0%100.0%64.6%9/491
granite3-dense2.0b1.6 GB
76.8%
67.6%3243 ms74.1%52.5%100.0%94.3%64.4%10/491
granite4.1:3b3b2.1 GB
81.3%
68.7%8223 ms75.0%52.6%100.0%90.2%64.4%11/491
:LFM2.5-350M.350m229MB
66.2%
68.8%424 ms75.0%25.0%100.0%36.7%64.2%12/491
codegeex4:9b9.4b5.5 GB
85.6%
66.4%14173 ms73.1%51.5%92.5%89.9%64.2%13/491
devstral:24b24b14.3 GB
84.7%
66.1%122585 ms72.9%53.5%100.0%91.1%64.2%14/491
granite-code:3b3b2.0 GB
78.6%
67.1%3595 ms73.7%51.1%96.3%89.7%64.0%15/491
marco-o1:7b7b4.7 GB
87.4%
64.1%26691 ms71.2%54.8%100.0%88.7%63.9%16/491
openchat:latest7b4.1GB
88.1%
56.7%23024 ms65.3%55.6%100.0%94.2%63.7%17/491
translategemma:4b4b3.3 GB
87.3%
64.8%19302 ms71.8%54.0%95.0%90.9%63.7%18/491
granite3 moe:3b3.4b2.1 GB
93.3%
50.1%7125 ms58.1%55.0%100.0%93.0%63.6%19/491
granite3.3:8b8.17b4.9 GB
77.1%
68.1%15931 ms74.5%52.8%100.0%92.5%63.6%20/491
qwen2.5-coder:7b7.62b4.7 GB
83.4%
68.0%17516 ms74.4%52.5%92.5%90.6%63.6%21/491
qwen2.5:3b-instruct-q6_K3b2.5 GB
81.3%
65.5%8950 ms72.4%53.7%100.0%90.7%63.6%22/491
dolphin-llama3:8b8b4.7 GB
67.0%
70.3%1646 ms76.3%51.5%100.0%92.9%63.5%23/491
gemma2.0b1.7 GB
79.2%
66.6%5511 ms73.3%53.4%100.0%87.9%63.2%24/491
granite4.2:8b8b5.3 GB
88.2%
63.4%54280 ms70.7%55.2%96.3%88.6%63.2%25/491
deepcoder:14b14b9.0 GB
89.8%
61.4%97440 ms69.1%55.6%96.3%90.1%63.2%26/491
qwen2.51.5b986 MB
88.1%
65.0%1588 ms72.0%54.1%87.8%86.4%63.1%27/491
wizardlm2:7b7.24b4.1 GB
83.4%
65.4%23023 ms72.3%54.0%93.7%92.4%63.1%28/491
granite4.1:3b3.4b2.1 GB
79.4%
67.1%9630 ms73.7%53.4%95.0%91.4%63.0%29/491
codegemma:7b9b5.0 GB
84.7%
63.6%26126 ms70.9%54.4%96.3%90.3%62.9%30/491
opencoder:8b7.8b4.7 GB
77.0%
69.4%20001 ms75.5%52.4%96.3%89.7%62.9%31/491
MiniCPM4 0.5B0.5b321mb
74.3%
67.2%1195 ms73.8%26.2%96.3%33.3%62.8%32/491
granite3.1-dense:8b8.17b5.0 GB
82.2%
64.7%25696 ms71.8%54.0%96.3%91.2%62.8%33/491
openthinker:7b7.6b4.7 GB
91.9%
62.3%124226 ms69.8%56.4%97.0%82.6%62.8%34/491
qwen3:4b-q8_04.0b4.4 GB
83.8%
62.8%53274 ms70.2%55.6%100.0%88.4%62.7%35/491
qwen3:4b-instruct-2507-q8_04b4.3 GB
96.7%
39.9%3710 ms51.9%58.3%100.0%97.2%62.7%36/491
hermes3:8b8b4.7 GB
79.7%
64.8%65761 ms71.9%54.2%96.3%92.9%62.6%37/491
internlm2:1.8b1.89b1.1 GB
74.9%
70.4%22490 ms76.3%52.2%100.0%85.0%62.6%38/491
granite3.2:8b8.2b4.9 GB
74.2%
67.3%18671 ms73.8%53.1%100.0%91.2%62.6%39/491
granite-code:8b8b4.6 GB
75.3%
67.5%6427 ms74.0%53.0%100.0%87.7%62.6%40/491
qwen2.5-coder:1.5b1.54b986 MB
69.8%
67.0%1838 ms73.6%52.9%100.0%89.4%62.5%41/491
llama3.1:8b8b4.9 GB
73.9%
67.5%45121 ms74.0%53.1%100.0%91.5%62.5%42/491
qwen2.5:7b7.62b4.7 GB
79.5%
63.8%15312 ms71.0%55.1%100.0%89.3%62.4%43/491
command-r7b-arabic:7b7b5.1 GB
82.9%
67.3%21770 ms73.9%53.1%87.3%91.2%62.4%44/491
granite3.22b1.5 GB
76.2%
63.7%1708 ms71.0%55.4%100.0%87.3%62.3%45/491
olmo2:7b7b4.5 GB
76.9%
66.2%7360 ms73.0%53.0%96.3%88.1%62.2%46/491
qwen3:14b14b9.3 GB
81.1%
65.8%89734 ms72.6%53.9%93.7%89.2%62.2%47/491
hermes3:3b3b2.0 GB
74.4%
64.8%5345 ms71.8%54.0%100.0%90.7%62.2%48/491
gemma2:2b2.2b1.6 GB
75.8%
66.3%2703 ms73.0%53.5%93.7%89.8%62.1%49/491
phi4:14b14b9.1 GB
74.2%
65.1%37178 ms72.1%53.9%100.0%92.6%62.1%50/491
qwen3:4b-instruct-2507-q4_K_M4b2.5 GB
93.3%
38.2%2791 ms49.5%57.5%100.0%96.5%62.0%51/491
granite3.1-dense2b1.6GB
85.2%
54.6%1504 ms63.7%58.7%100.0%88.9%61.9%52/491
llama3.2:3b3b2.0 GB
83.3%
58.5%5278 ms66.7%55.8%95.0%91.4%61.9%53/491
granite4:1b1b3.3 GB
76.3%
60.1%3151 ms68.0%55.2%98.9%92.4%61.9%54/491
Falcon31b1.8 GB
78.8%
62.4%1369 ms69.9%55.0%100.0%81.5%61.8%55/491
gemma3:4b3.9b3.4 GB
100.0%
44.6%10954 ms55.7%61.0%100.0%93.5%61.8%56/491
mistral-nemo:12b12.2b7.1 GB
79.5%
64.2%28627 ms71.4%54.4%96.3%88.9%61.8%57/491
aya-expanse:8b8.03b5.1 GB
80.0%
62.9%41902 ms70.4%55.4%100.0%87.1%61.8%58/491
exaone-deep:7.8b7.8b4.8 GB
81.4%
63.5%68567 ms70.8%55.8%100.0%84.2%61.8%59/491
nuextract:3.8b3.8b2.2 GB
74.5%
66.6%5124 ms73.3%53.5%94.0%90.9%61.8%60/491
qwen2.5-coder:3b-instruct-q8_03b3.3 GB
76.0%
68.3%6262 ms74.6%52.8%92.5%87.6%61.8%61/491
gemma4:e2b4.6b4.6 GB
79.2%
64.8%13477 ms71.8%55.2%96.2%87.9%61.8%62/491
lfm2.5-thinking1.2b731 MB
90.8%
52.6%9364 ms61.8%59.0%94.8%93.7%61.6%63/491
qwen21.5b934 MB
78.9%
60.1%598 ms68.1%55.6%100.0%80.2%61.6%64/491
qwen2.5:15b986 MB
73.9%
66.3%4738 ms73.1%26.9%95.0%33.3%61.6%65/491
codeqwen:7b7.3b4.2 GB
78.3%
63.8%17411 ms71.1%54.3%96.3%89.3%61.6%66/491
gemma2:9b9.24b5.4 GB
79.2%
65.7%20940 ms72.5%53.7%92.5%87.9%61.5%67/491
exaone-deep:2.4b2.4b1.6 GB
84.6%
60.9%23415 ms68.7%57.3%100.0%82.9%61.5%68/491
granite3.32.0b1.5 GB
96.7%
44.2%2428 ms55.4%61.2%100.0%92.0%61.4%69/491
openhermes:latest7b4.1GB
74.8%
61.3%3803 ms68.8%55.0%97.3%91.6%61.4%70/491
OLMo-2-0425-1B-Instruct1b935MB
81.1%
65.0%4299 ms72.0%28.0%96.2%33.3%61.4%71/491
phi4-mini:latest3.8b2.5 GB
80.8%
63.3%21930 ms70.6%54.5%92.5%89.4%61.4%72/491
granite4:3b3b2.1 GB
75.6%
59.6%2876 ms67.7%55.7%99.5%90.5%61.4%73/491
neural-chat7b4.7 GB
89.3%
49.1%1356 ms59.3%60.2%100.0%89.2%61.3%74/491
qwen3:4b-thinking-2507-q4_K_M4b2.5 GB
80.1%
64.1%32556 ms71.3%56.0%92.4%88.9%61.3%75/491
hf.co/mradermacher/Yi-Coder-1.5B-Chat-GGUF:Q4_K_M1.5b963 MB
73.5%
65.0%2509 ms72.0%53.9%96.3%86.1%61.2%76/491
Bharat-Tiny-LLM0.5b397MB
75.8%
63.4%1961 ms70.7%29.3%96.3%33.3%61.2%77/491
llama3-chatqa:8b8b4.7 GB
67.9%
67.4%24719 ms73.9%53.1%100.0%90.4%61.2%78/491
deepseek-coder:1.3b-instruct-q8_01.3b1.4 GB
69.5%
66.5%2888 ms73.2%53.6%100.0%85.8%61.2%79/491
llama3.2:3b-instruct-q8_03b3.4 GB
72.4%
65.0%5872 ms72.0%54.2%100.0%86.8%61.2%80/491
granite4:tiny-h6.9b4.2 GB
68.1%
64.8%3065 ms71.9%54.2%100.0%90.5%61.2%81/491
command-r7b:latest7b5.1GB
84.3%
54.4%5298 ms63.6%57.6%98.2%91.7%61.1%82/491
granite4:350m350m708 MB
59.4%
67.8%788 ms74.2%53.4%100.0%89.9%61.1%83/491
phi4-mini:3.8b-q8_03.8b4.1 GB
76.9%
62.0%15516 ms69.6%55.7%100.0%87.6%61.1%84/491
granite3.32b1.5 GB
79.0%
58.5%3330 ms66.5%56.5%98.0%89.8%61.1%85/491
smallthinker:3b3b3.6 GB
78.7%
61.2%27632 ms69.0%56.4%100.0%87.5%61.1%86/491
granite4.1:8b8.8b5.3 GB
96.7%
41.7%12277 ms53.3%60.8%100.0%94.7%61.0%87/491
mistral:7b7.24b4.4 GB
86.6%
52.0%9572 ms61.6%58.5%100.0%91.9%61.0%88/491
olmo-3:7b7.3b4.5 GB
83.5%
58.9%139635 ms67.1%56.4%97.0%87.8%61.0%89/491
granite3-dense2b1.6 GB
68.3%
62.8%1685 ms69.9%54.9%98.5%91.6%61.0%90/491
qwen3-vl:4b4b3.3 GB
80.5%
66.2%35447 ms73.0%53.7%88.7%85.9%61.0%91/491
granite3.3:2b2b1.5GB
72.3%
64.3%5132 ms71.4%54.6%100.0%86.1%60.9%92/491
llama3-groq-tool-use:8b8b4.7 GB
71.2%
65.3%6053 ms72.2%53.8%95.0%91.0%60.9%93/491
cogito3b2.2 GB
71.8%
65.4%4372 ms72.3%54.1%100.0%83.8%60.8%94/491
neural-chat:7b7.24b4.1 GB
72.4%
65.7%10308 ms72.6%53.9%93.7%90.5%60.8%95/491
qwen2.5:1.5b1.54b986 MB
69.5%
65.9%2005 ms72.7%53.7%100.0%82.2%60.8%96/491
notus:7b7b4.1 GB
85.2%
52.7%7704 ms62.1%58.2%100.0%90.6%60.8%97/491
gemma3n:e4b6.9b9.8 GB
90.2%
54.2%57693 ms63.3%58.8%90.5%92.3%60.7%98/491
codellama:7b7b3.8 GB
68.4%
65.8%19056 ms72.7%53.3%96.3%91.3%60.7%99/491
phi2.7b1.6 GB
77.2%
60.9%6542 ms68.7%55.9%96.3%88.0%60.6%100/491
granite3.1-dense:2b2b1.6GB
80.5%
56.7%4210 ms65.3%57.2%98.2%88.2%60.6%101/491
LFM2.5-1.2B-Instruct1.2b730MB
62.0%
63.8%1101 ms71.0%29.0%97.0%35.0%60.6%102/491
Alloma 1B Instruct1b807Mb
57.8%
68.6%767 ms74.8%25.2%100.0%33.3%60.6%103/491
aya:8b8.0b4.8 GB
83.3%
49.1%5735 ms57.5%56.1%100.0%90.3%60.6%104/491
magicoder:7b7b3.8 GB
75.7%
64.5%17937 ms71.6%54.1%92.5%88.8%60.6%105/491
stablelm2:1.6b1.64b983 MB
71.7%
64.6%9704 ms71.7%54.2%100.0%85.5%60.6%106/491
dolphincoder:7b7b4.2 GB
79.7%
63.1%691876 ms70.5%54.6%96.3%83.3%60.6%107/491
llama3.2:3b-instruct-q5_K_M3b2.3 GB
67.8%
65.5%5031 ms72.4%53.9%100.0%87.6%60.6%108/491
granite3-moe1.0b821 MB
66.3%
62.5%1044 ms69.4%54.7%99.4%88.1%60.5%109/491
dolphin-mistral:latest7b4.1 GB
85.7%
49.7%1549 ms59.8%59.6%100.0%88.3%60.5%110/491
StableLM Zephyr 1.6B1.6b1 GB
76.9%
62.7%3061 ms70.1%29.9%92.5%33.3%60.5%111/491
qwen2.5:3b3.09b1.9 GB
76.7%
62.0%13949 ms69.6%55.3%96.2%87.1%60.5%112/491
phi4-mini3.8b2.5 GB
76.8%
58.5%5834 ms66.8%56.7%98.5%89.5%60.5%113/491
gemma4:e4b7.5b6.6 GB
82.1%
56.3%18167 ms65.1%57.9%97.5%89.7%60.5%114/491
StableLM Zephyr1.6b980MB
66.7%
62.4%742 ms69.9%55.0%100.0%85.3%60.4%115/491
hf.co/LiquidAI/LFM2-700M-GGUF:Q4_K_M700m972 MB
75.9%
59.7%1982 ms67.7%56.1%96.2%86.5%60.4%116/491
gemma3ne2b5.6 GB
82.5%
63.6%21745 ms70.9%54.7%82.3%89.5%60.3%117/491
qwen2-math:7b7.6b4.4 GB
96.7%
40.4%13495 ms52.3%62.5%100.0%96.2%60.3%118/491
llama3.21.0b1.3 GB
77.2%
60.1%3865 ms68.8%55.3%94.1%88.0%60.2%119/491
qwen31.7b1.4GB
78.0%
58.8%6114 ms67.0%57.1%100.0%84.5%60.2%120/491
SmolLM3-3B-GGUF3b1.9 GB
76.7%
59.7%6406 ms67.8%56.1%100.0%84.4%60.2%121/491
phi3:mini3.8b2.2 GB
74.0%
61.8%7478 ms69.2%55.1%95.4%88.4%60.2%122/491
granite-3.3-2b-instruct-GGUF:Q4_K_M2b1.5 GB
79.8%
63.7%6488 ms70.9%54.8%87.2%86.0%60.2%123/491
SmolLM2 1.7B Instruct1.7b1.1 GB
72.6%
65.3%4351 ms72.2%27.8%95.0%33.3%60.2%124/491
deepseek-coder:6.7b7b3.8 GB
72.1%
66.5%19073 ms73.2%53.4%96.3%83.5%60.2%125/491
Gemma 3 270M270m292 MB
65.9%
60.1%1144 ms67.5%53.8%96.4%88.9%60.2%126/491
hermes38b4.7 GB
80.4%
54.9%7694 ms63.5%57.8%98.7%90.6%60.2%127/491
glm4:9b9b5.5 GB
77.2%
59.1%16169 ms66.8%56.5%96.3%90.8%60.2%128/491
command-r7b:latest8b5.1 GB
74.2%
62.6%49433 ms70.1%55.6%100.0%84.0%60.1%129/491
yi-coder:9b8.8b5.0 GB
73.2%
65.6%10923 ms72.5%53.7%92.5%86.3%60.1%130/491
qwen2.5:0.5b-instruct-fp160.5b994 MB
95.0%
40.3%2508 ms52.2%62.7%100.0%92.6%60.1%131/491
dolphin38b4.9 GB
69.4%
61.2%4283 ms68.6%55.1%98.5%90.1%60.1%132/491
deepseek-coder-v2:16b16b8.9 GB
68.3%
65.7%14217 ms72.6%53.5%92.5%91.2%60.1%133/491
internlm21.8b1.1 GB
57.9%
66.5%1336 ms73.2%53.4%100.0%88.6%59.9%134/491
MiniCPM5-2B-GGUF:latest2b1.6GB
76.1%
64.0%6045 ms71.2%55.3%100.0%75.7%59.9%135/491
yi-coder:1.5b1.48b866 MB
77.3%
61.9%60424 ms69.5%55.2%100.0%83.6%59.9%136/491
wizard-math:7b7b4.1 GB
98.3%
40.4%10210 ms52.4%62.5%100.0%90.3%59.9%137/491
nemotron-3-nano:4b4.0b2.8 GB
70.0%
65.7%29585 ms72.5%53.7%100.0%82.6%59.9%138/491
qwen2.5-coder:3b-instruct-q6_K3b2.5 GB
70.5%
65.5%4725 ms72.4%53.9%96.3%83.2%59.9%139/491
EXAONE Deep2.4b4.2 GB
92.9%
44.3%6743 ms55.4%62.7%100.0%89.3%59.8%140/491
gemma:7b9b5.0 GB
72.4%
60.0%12719 ms68.0%56.0%97.0%91.3%59.8%141/491
wizardlm22b4.7 GB
85.2%
48.4%25546 ms58.7%60.5%100.0%93.0%59.7%142/491
granite3.1-moe1b1.4 GB
72.6%
65.6%3713 ms72.5%53.7%87.3%86.6%59.7%143/491
qwen2-math:1.5b-instruct-q5_11.5b397 MB
76.3%
58.8%4340 ms67.1%56.7%100.0%82.3%59.7%144/491
stablelm2:1.6b1.6b1 GB
78.3%
58.9%2964 ms67.1%32.9%94.0%33.3%59.7%145/491
codestral:22b22b12.6 GB
76.5%
61.1%68448 ms68.9%55.3%92.5%88.9%59.7%146/491
nemotron-mini:4b4b2.7 GB
60.3%
67.1%6982 ms73.7%53.2%100.0%89.2%59.7%147/491
falcon-h10.5b448b
77.5%
57.2%17576 ms65.2%57.1%95.0%87.6%59.6%148/491
Llama 3.2 1B Instruct (Q4_K_M)1b807mb
65.1%
62.3%766 ms69.9%54.9%100.0%82.4%59.6%149/491
tulu3:8b8b4.9 GB
78.7%
57.1%8702 ms65.7%57.3%97.1%86.1%59.6%150/491
gemma30.27b291 MB
52.3%
66.6%1109 ms73.3%52.4%100.0%88.9%59.5%151/491
sam860/olmo2:1b1b1.6 GB
76.0%
60.9%1342 ms68.8%55.9%85.0%87.8%59.5%152/491
Qwen2.5-0.5B-Instruct0.49b491 MB
93.3%
38.1%1358 ms50.4%49.6%100.0%33.3%59.5%153/491
qwen2.5-coder:3b3.09b1.9 GB
63.7%
67.5%8753 ms74.0%53.2%96.3%86.8%59.5%154/491
falcon2:11b11b6.4 GB
31.9%
56.7%10414 ms63.4%40.4%100.0%100.0%59.5%155/491
orca-mini:7b7b3.8 GB
69.0%
59.8%5364 ms67.8%56.0%100.0%89.7%59.5%156/491
qwen2.5:3b-instruct-fp163b6.2 GB
68.2%
64.1%21559 ms71.3%54.6%96.3%88.7%59.5%157/491
llama2.01.0b1.3 GB
80.5%
65.4%17867 ms72.3%54.1%74.0%90.7%59.4%158/491
aya-expanse8b5.0 GB
82.9%
47.8%4022 ms58.2%59.9%100.0%92.0%59.4%159/491
lfm3-audio:2b2b1.7 GB
50.7%
52.6%11151 ms58.8%41.6%100.0%83.3%59.4%160/491
falcon3:7b7b4.6 GB
74.3%
59.8%11066 ms67.8%56.3%96.5%86.4%59.4%161/491
deepcoder:1.5b1.5b1.1 GB
80.9%
62.2%19354 ms69.7%55.1%92.5%78.0%59.4%162/491
starling-lm7b4.1 GB
76.8%
55.5%10816 ms64.1%57.6%97.9%89.4%59.3%163/491
tinyllama1.1b637 MB
68.0%
63.0%1243 ms70.4%54.8%100.0%77.1%59.2%164/491
xwinlm7b3.8 GB
77.5%
58.5%4551 ms66.8%56.5%90.2%87.7%59.2%165/491
qwen2.5:3b3b1.9GB
77.7%
55.1%5029 ms64.1%57.7%95.0%88.6%59.2%166/491
qwen:4b4b2.3 GB
59.5%
69.4%7342 ms75.5%52.4%90.2%92.9%59.2%167/491
Qwen21.5b934 MB
76.8%
54.2%795 ms63.4%57.0%90.5%85.2%59.1%168/491
olmo2:7b7.3b4.5 GB
83.3%
44.7%4021 ms53.8%57.7%100.0%87.7%59.1%169/491
qwen3:8b8.19b5.2 GB
68.0%
65.4%62971 ms72.3%53.8%90.0%90.7%59.1%170/491
granite3.1-moe:3b3.3b2.0 GB
57.9%
66.1%6409 ms72.9%53.5%100.0%90.1%59.1%171/491
neural-chat:7b7b4.1 GB
71.1%
57.4%4972 ms65.6%56.9%98.2%90.3%59.1%172/491
nous-hermes:7b7b3.8 GB
57.9%
65.0%6662 ms72.0%53.9%100.0%92.2%59.1%173/491
Granite 4.0 H-1B1b901 MB
72.6%
63.8%6533 ms71.0%54.9%91.0%83.8%59.0%174/491
Ask-0.5B-GGUF0.5b631MB
60.2%
65.2%890 ms72.2%27.8%100.0%33.3%59.0%175/491
tinydolphin:1.1b1.1b636 MB
58.4%
69.2%1687 ms75.4%24.6%93.7%33.3%59.0%176/491
Qwen2.5 1.5B Instruct5b637 MB
73.4%
61.8%3579 ms69.5%30.5%96.2%33.3%59.0%177/491
LFM2-350M350m229 MB
64.1%
66.2%1970 ms73.0%27.0%87.3%33.3%59.0%178/491
exaone3.52.4b1.6 GB
76.7%
55.0%4432 ms64.0%57.9%95.9%88.4%59.0%179/491
yi-coder1.5b866 MB
69.8%
61.5%2167 ms69.3%55.3%96.3%81.7%58.9%180/491
Llama 3.2 1B1b1.3 GB
68.4%
61.9%3592 ms69.5%55.3%100.0%81.3%58.9%181/491
Llama 3.2 1B Instruct1b807 MB
69.0%
62.0%3741 ms69.6%30.4%94.0%33.3%58.9%182/491
StableLM 2 Zephyr1.6 billion983MB
64.0%
63.4%1858 ms70.8%29.2%100.0%33.3%58.9%183/491
qwen3:4b4b2.5 GB
81.7%
57.7%40736 ms66.2%57.8%86.4%88.8%58.9%184/491
internlm2:1.8b1.8b1.1 GB
61.2%
58.1%441 ms64.9%55.7%95.7%90.8%58.8%185/491
gemma22.0b1.6 GB
78.6%
51.0%6095 ms60.9%59.7%100.0%88.5%58.7%186/491
ternary-bonsai1.7b3.4 GB
91.4%
53.7%13473 ms62.9%58.3%81.0%86.2%58.7%187/491
phi3:latest3.8b2.2GB
78.9%
56.8%44801 ms64.8%57.3%97.5%81.3%58.7%188/491
exaone3.5:7.8b7.8b4.8 GB
86.6%
44.9%8323 ms55.9%61.3%100.0%89.4%58.7%189/491
cogito:8b8.0b4.9 GB
69.6%
56.2%6830 ms65.0%57.7%100.0%90.6%58.7%190/491
vertalily1.21.0b600 MB
67.4%
67.1%1880 ms73.7%53.6%82.0%86.4%58.6%191/491
D1-3B3b1.7GB
74.5%
60.3%4138 ms68.2%31.8%88.0%33.3%58.6%192/491
smollm1.7b990 MB
83.9%
44.8%4644 ms55.8%61.4%100.0%90.6%58.5%193/491
tulu38b4.9 GB
72.5%
60.5%16815 ms68.4%57.0%94.0%84.8%58.5%194/491
Bielik-1.5B-v3.0-Instruct-GGUF:Q8_01.5b1.7 GB
62.8%
66.2%5018 ms72.9%27.1%100.0%33.3%58.5%195/491
OLMo-1B-Instruct1b935 MB
70.1%
60.2%3904 ms68.2%31.8%100.0%33.3%58.5%196/491
StableLM2:1.6B1.6b103mb
66.3%
64.2%12375 ms71.4%71.4%95.0%84.6%58.5%197/491
gemma3:12b12b8.2 GB
82.4%
60.1%124448 ms68.1%55.6%78.7%88.4%58.5%198/491
bonsai1.7b248 MB
76.7%
61.0%3672 ms68.8%55.5%79.0%89.4%58.4%199/491
qwen2.5:1.5b-instruct-fp161.5b3.1 GB
85.0%
43.4%3031 ms52.7%61.6%100.0%91.7%58.4%200/491
deepscaler:1.5b1.5b3.6 GB
100.0%
34.2%31452 ms47.4%64.8%100.0%91.3%58.4%201/491
qwen30.6b522 MB
74.2%
55.5%5306 ms64.2%57.4%95.7%87.5%58.3%202/491
gemma3-it1.0b689 MB
65.4%
65.1%8975 ms72.1%53.9%88.7%88.6%58.3%203/491
qwen2.5:1.5b-instruct-q5_15b1.2 GB
73.2%
65.7%4366 ms72.6%53.8%78.0%86.3%58.3%204/491
granite3.1-moe1.0b1.4 GB
78.9%
63.0%5409 ms70.4%55.0%73.5%88.3%58.2%205/491
qwen2-math:1.5b1.5b935MB
95.0%
36.2%15537 ms48.9%68.2%100.0%92.4%58.2%206/491
yi:6b6b3.5 GB
73.3%
56.7%9122 ms65.1%57.0%94.5%87.3%58.2%207/491
deepseek-r1:8b8.2b5.2 GB
80.2%
50.7%53742 ms60.5%60.4%97.0%88.8%58.2%208/491
qwen2.50.5b397 MB
71.9%
57.6%2590 ms66.0%56.9%95.9%83.5%58.1%209/491
medpsy1.7b4.1 GB
90.2%
49.3%28452 ms59.4%60.9%81.0%92.5%58.0%210/491
Qwen 2.5 Coder3b1.9GB
59.0%
63.5%2672 ms70.8%54.6%100.0%83.7%58.0%211/491
dolphin-llama38b4.7 GB
58.7%
60.9%1960 ms67.9%54.7%99.2%86.5%58.0%212/491
atem-wisdom1.5b986 MB
69.6%
62.1%7373 ms69.7%55.7%96.3%78.7%57.9%213/491
MeetSolanki/MeetAISmall0.3b241 MB
73.0%
56.8%2194 ms65.4%57.9%90.5%85.8%57.9%214/491
llama3.2:1b1b1.3 GB
70.5%
53.3%3741 ms62.7%50.1%100.0%60.1%57.9%215/491
Granite3.1-dense:1b1b
75.0%
59.5%46500 ms67.6%56.7%96.2%78.2%57.9%216/491
gemma3:1b1b883 MB
66.1%
63.1%27340 ms70.5%55.5%97.0%81.6%57.8%217/491
llama3.2:1b-instruct-q5_K_M1.24b800MB
66.1%
63.1%27340 ms70.5%55.5%97.0%81.6%57.8%218/491
EuroLLM 1.7B Instruct (Q4_K_M)1.7b1.0 GB
67.3%
59.5%2601 ms67.6%32.4%94.0%33.3%57.8%219/491
deepscaler1.5b3.6 GB
100.0%
33.1%19449 ms46.4%65.1%100.0%88.3%57.7%220/491
falcon31.0b1.8 GB
73.2%
57.9%4049 ms65.1%56.7%96.3%79.7%57.7%221/491
lfm20.35b229 MB
79.7%
44.9%1370 ms55.9%61.3%98.5%87.2%57.7%222/491
exaone-4.01.2b812 MB
90.2%
41.2%48734 ms53.0%63.0%100.0%86.8%57.7%223/491
Llama SmolTalk 3.2 1B Instruct Q4_K_M1b672 MB
81.6%
44.6%1280 ms55.7%61.4%100.0%83.8%57.7%224/491
Dolphin 3.0 Llama 3.2 1B1b1.3 GB
66.4%
60.0%3442 ms68.0%55.8%94.0%85.3%57.7%225/491
orca-mini:3b3.43b2.0 GB
60.0%
64.8%6850 ms71.8%54.0%90.0%90.5%57.7%226/491
medgemma:4b4.3b3.3 GB
75.9%
48.4%13315 ms58.7%60.3%100.0%90.9%57.7%227/491
ministral-3:3b-instruct-2512-q8_03b4.5 GB
68.1%
64.6%21322 ms71.7%54.0%82.3%89.6%57.7%228/491
Phi-4-mini-instruct3.8b2.49 GB
78.0%
51.7%2223 ms61.3%59.0%90.5%86.3%57.6%229/491
Medllama-1B-Instruct-v3-GGUF:Q4_K_M1 b807 MB
75.4%
45.2%1069 ms56.2%61.2%100.0%88.8%57.6%230/491
MiniCPM5-1B1.08b688 MB
72.4%
60.8%73454 ms68.6%31.4%88.7%33.3%57.6%231/491
h2oai500m350 MB
60.4%
59.8%1161 ms67.9%0.0%100.0%81.1%57.5%232/491
smollm2:360m360 million725 MB
89.7%
42.1%1101 ms51.7%48.3%100.0%33.3%57.5%233/491
qwen2.5-coder:3b3b1.9 GB
66.8%
56.4%2611 ms64.8%57.1%98.5%84.0%57.5%234/491
Qwen2:1.5b1.5b935 MB
66.4%
56.7%1907 ms64.2%57.2%98.1%84.3%57.5%235/491
TinyLlama-1.1B-Chat-v1.01b407MB
60.9%
62.9%1521 ms70.3%29.7%100.0%33.3%57.4%236/491
lfm2.5:8b8.5b5.2 GB
85.2%
44.1%22189 ms55.3%62.9%97.0%88.9%57.4%237/491
llama3:8b8b4.7 GB
64.2%
63.5%21058 ms70.8%54.4%87.3%89.9%57.4%238/491
smollm21.7b1.8 GB
66.0%
65.6%2845 ms72.5%54.1%78.0%87.8%57.3%239/491
stablelm-zephyr3.0b1.6 GB
66.7%
58.0%2475 ms66.3%56.5%98.1%80.4%57.3%240/491
Nemotron Mini 4B Instruct Q4_K_M4b2.7GB
59.5%
53.6%679 ms62.9%57.9%100.0%90.2%57.3%241/491
WizardLM-2 7B2.7b4.1B
73.8%
60.3%3879 ms68.3%55.7%80.4%85.9%57.3%242/491
Borealis 1B Instruct1b806 MB
59.1%
63.0%2185 ms70.4%29.6%100.0%33.3%57.2%243/491
gemma3:4b4b3.4gb
76.9%
53.0%20524 ms61.9%58.8%89.1%89.8%57.2%244/491
llama3.2:3b3.21b2.0 GB
66.0%
54.6%7093 ms61.7%58.6%97.0%92.9%57.1%245/491
deepseek-r1:8b8.19b5.2 GB
96.4%
48.7%277705 ms58.9%56.2%81.0%68.2%57.1%246/491
phi3:3.8b-mini-128k-instruct-q4_K_M3.8b2.4 GB
67.7%
54.1%8205 ms61.3%59.1%100.0%89.1%57.1%247/491
dolphin-phi2.7b1.6GB
83.0%
45.4%954 ms56.3%61.2%90.5%83.8%57.0%248/491
granite40.35b708 MB
67.5%
56.5%1956 ms64.6%57.0%97.3%81.4%56.9%249/491
smollm:1.7b1.7b1GB
60.4%
55.1%1562 ms64.1%57.8%100.0%88.1%56.9%250/491
falcon31b1.8 GB
74.4%
64.8%6606 ms71.9%54.1%74.0%81.3%56.8%251/491
H2O-Danube3-0.5B500m317 MB
66.8%
59.6%1467 ms67.7%32.3%85.0%33.3%56.8%252/491
ministral-33.0b3.0 GB
67.4%
59.3%9955 ms67.5%56.2%86.4%89.0%56.7%253/491
llama3.2:3b-instruct-fp163b6.4 GB
69.1%
53.3%13342 ms60.6%58.6%97.0%89.7%56.7%254/491
hunyuan-instruct1.8b1.1 GB
98.3%
33.4%15320 ms46.7%65.3%100.0%82.1%56.6%255/491
mistral-nemo12b7.1 GB
85.2%
45.1%3382 ms56.1%61.6%83.0%91.4%56.6%256/491
TinyLlama 1.1B1.1 billion637 MB
36.0%
42.8%4524 ms57.7%45.1%150.0%57.9%56.6%257/491
qwen2.5:7b7.6b4.7 GB
70.3%
49.7%11470 ms59.7%59.7%100.0%89.1%56.6%258/491
qwen2.5-coder:1.5b1.5b986 MB
63.6%
55.2%3755 ms64.1%57.5%97.5%83.7%56.5%259/491
GRAFT-1B1b971 MB
62.6%
65.8%2088 ms72.7%54.0%74.0%88.8%56.4%260/491
DeepSeek-R1-Distill-Qwen-1.5B1.5b1.1 GB
95.0%
30.8%12150 ms44.6%55.4%100.0%33.3%56.3%261/491
Granite 4 3B-H3b1.9 GB
60.3%
59.3%20217 ms65.4%56.8%97.0%88.3%56.3%262/491
mistral-openorca:7b7b4.1 GB
57.3%
57.8%8926 ms64.3%56.7%100.0%90.9%56.3%263/491
llama-3.2-1b-instruct-fine-tuned1.24b808 MB
65.4%
53.6%2733 ms62.4%58.4%98.5%84.4%56.3%264/491
deepseek-coder1.3b776 MB
57.2%
63.3%2095 ms70.7%54.5%96.3%77.3%56.2%265/491
granite3.22.0b1.5 GB
83.9%
50.8%8569 ms60.7%59.6%81.0%84.3%56.2%266/491
gemma3270m291MB
61.0%
56.1%7262 ms64.6%56.6%96.3%87.5%56.2%267/491
qwen2.5:0.5b-instruct0.5b486 MB
66.1%
53.1%4615 ms62.5%58.4%97.4%82.4%56.2%268/491
MeetSolanki/MeetAISmall0.7b523 MB
56.8%
55.0%1839 ms64.0%57.8%100.0%89.2%56.2%269/491
Gemma 2 2B2.2b1.6 GB
70.5%
48.3%7963 ms58.6%41.4%100.0%33.3%56.2%270/491
stablelm2:11.6 billion1.8 GB
70.9%
50.0%15400 ms60.0%59.5%100.0%85.0%56.1%271/491
qwen:0.5b0.5b500M
45.1%
67.1%3422 ms73.7%53.2%100.0%83.5%56.1%272/491
stable-beluga:latest1b3.8 GB
55.5%
53.0%1138 ms62.4%58.1%100.0%90.1%55.9%273/491
Borealis-270M-Instruct-Preview270m303 MB
53.9%
61.3%1824 ms69.1%30.9%100.0%33.3%55.9%274/491
gemma3:4b-it-qat4b4.0 GB
72.5%
47.5%22196 ms57.1%60.7%98.5%88.7%55.9%275/491
mistral:7b7.2b4.4 GB
60.1%
54.6%8602 ms63.7%58.7%100.0%87.8%55.8%276/491
phi4-mini-reasoning:3.8b3.8b3.2 GB
81.8%
47.0%35185 ms57.6%61.6%87.2%87.1%55.8%277/491
yi:9b9b5.0 GB
66.5%
50.5%13933 ms60.4%59.7%97.0%90.4%55.8%278/491
Llama-3.2-1B-no-robots1.24b808 MB
67.1%
53.0%1106 ms62.0%58.5%94.1%79.6%55.8%279/491
phi3:3.8b-mini-4k-instruct-q8_03.8b4.1 GB
60.1%
53.9%5376 ms61.1%58.5%100.0%89.8%55.8%280/491
orca-mini3b2.0 GB
55.9%
54.0%1648 ms61.4%57.7%99.6%89.2%55.7%281/491
hermes33.0b2.0 GB
56.7%
60.9%4374 ms68.7%55.7%91.0%86.5%55.6%282/491
granite4.2:3b3.7b2.2 GB
79.0%
45.0%24423 ms56.0%62.6%90.2%90.2%55.6%283/491
lfm2-1.2b1.2b730mb
74.5%
47.4%15360 ms57.9%60.5%90.0%90.4%55.5%284/491
granite43b2.1 GB
59.2%
51.7%1254 ms61.4%58.2%100.0%83.7%55.5%285/491
granite3.3:8b8.2b4.9 GB
58.4%
54.6%10937 ms61.7%58.5%100.0%90.5%55.5%286/491
qwen3.5:9b9.0b6.6 GB
67.4%
52.2%60490 ms59.8%59.1%97.0%87.2%55.5%287/491
granite3-dense:8b8.2b4.9 GB
47.5%
61.8%20234 ms69.4%55.0%100.0%89.7%55.5%288/491
minicpm-v4.6:1b752.16m1.6 GB
70.0%
44.2%10317 ms55.4%62.4%100.0%91.3%55.4%289/491
treyleo161 billion1gb
41.2%
64.6%287 ms71.7%54.3%100.0%77.9%55.4%290/491
SmolLM2-360M-Instruct360 m270 MB
62.9%
54.1%395 ms63.3%36.7%100.0%33.3%55.3%291/491
Stable Code Instruct 3B Q4_K_M3b1.7GB
60.9%
49.8%430 ms59.8%59.6%100.0%79.5%55.2%292/491
smollm:1.7b-instruct-v0.2-q4_K_M1.7b1.1 GB
71.8%
43.9%1771 ms55.1%61.7%90.5%92.1%55.2%293/491
qwen2.5-coder3b1.9 GB
52.3%
57.9%4390 ms66.3%56.6%100.0%85.8%55.2%294/491
medllama2:7b7b3.8 GB
66.8%
51.2%10526 ms61.0%59.1%100.0%81.5%55.2%295/491
qwen2.5-coder-instruct3.0b2.1 GB
48.2%
66.1%3428 ms72.8%53.0%96.3%77.1%55.1%296/491
lfm3:1.7b1.7b103mb
63.6%
54.3%29 ms63.5%59.6%94.0%86.2%55.1%297/491
gemma3:4b-it-q8_04b5.0 GB
73.4%
45.6%27840 ms56.5%62.1%97.0%86.7%55.1%298/491
qwen2.5-coder:7b7.6b4.7 GB
65.7%
50.9%20152 ms58.7%59.6%100.0%84.8%55.0%299/491
qwen2:0.5b-instruct0.494b440 MB
52.3%
61.3%4230 ms69.1%55.5%100.0%77.8%54.9%300/491
Qwen2.5-0.5B-Instruct0.5b397 MB
68.2%
56.8%2019 ms65.4%34.6%80.4%33.3%54.9%301/491
phi3.5:3.8b3.8b2.2 GB
75.4%
51.0%20273 ms60.8%58.8%92.5%76.4%54.9%302/491
medgemma1.5:4b4.3b3.3 GB
96.4%
39.5%42574 ms51.6%63.7%76.2%86.5%54.8%303/491
granite4:3b3.4b2.1 GB
49.8%
57.2%2582 ms63.7%57.9%100.0%88.7%54.8%304/491
gemma2:2b-instruct-q8_02b2.8 GB
65.6%
49.0%8070 ms57.2%60.4%97.0%88.8%54.8%305/491
LFM2.5-1.2B Thinking2b731mb
75.9%
63.7%1 ms90.6%100.0%33.3%100.0%54.7%306/491
SmolLM2-360M-Instruct360m229MB
59.4%
61.2%1106 ms69.0%31.0%96.2%33.3%54.7%307/491
Borealis-1B-Instruct-Preview1 b806 MB
80.4%
46.8%3570 ms57.5%42.5%92.5%33.3%54.7%308/491
lfm3-vl:2b1.7b1.5 GB
63.1%
51.9%15500 ms61.5%59.6%100.0%82.3%54.7%309/491
yarn-mistral:7b7b4.1 GB
70.4%
59.5%29453 ms67.6%55.8%87.3%71.1%54.7%310/491
opencoder:1.5b-instruct-q4_K_M1.5b1.4 GB
78.0%
39.5%1516 ms46.6%62.4%100.0%82.1%54.6%311/491
GGUF Q4_K_M1.5b972 MB
55.4%
61.3%4305 ms69.0%31.0%94.0%33.3%54.5%312/491
hunyuan-0.5b-instruct0.5b320mb
85.2%
38.3%29509 ms50.6%63.6%100.0%76.3%54.3%313/491
dolphin3:8b8.0b4.9 GB
48.0%
58.5%3926 ms64.8%56.8%100.0%86.7%54.3%314/491
llama3:8b8.0b4.7 GB
62.3%
51.6%13816 ms59.3%59.5%100.0%83.5%54.3%315/491
deepseek-r11.5b1.1 GB
62.4%
53.4%10296 ms63.7%58.1%96.9%78.6%54.1%316/491
babar_jamali/gemma3-abliterated-1b806 MB
51.3%
60.1%22439 ms68.1%56.2%97.0%81.6%54.1%317/491
onellm-doey-v11.0b1.3 GB
47.2%
67.9%972 ms74.3%53.0%96.2%63.4%54.0%318/491
Ling-3.0-tiny-GGUF:Q4_K_M7.9b total (1.3b active)6.4GB
69.1%
48.7%3024 ms58.9%60.4%90.5%81.5%54.0%319/491
sailor21b1.1 GB
66.2%
49.8%5506 ms59.2%59.6%94.3%80.9%54.0%320/491
gemma4:e4b8b (4.5b effective)9.6 GB
65.8%
50.1%41750 ms58.1%61.2%94.0%86.5%54.0%321/491
qwen2:7b7.6b4.4 GB
58.5%
50.4%11793 ms58.3%59.6%100.0%87.7%54.0%322/491
granite4350m708 MB
71.3%
52.4%658 ms61.9%58.3%90.5%63.6%53.9%323/491
Yi-Coder 1.5B Chat1.5b866 MB
52.5%
59.4%1367 ms67.5%32.5%94.0%33.3%53.8%324/491
llama3.1:8b8.0b4.9 GB
59.9%
50.1%18677 ms58.1%59.6%96.2%90.0%53.8%325/491
falcon3:3b3.23b2.0 GB
86.7%
29.8%6623 ms41.8%64.6%100.0%82.1%53.8%326/491
jewelzufo/VertaLily-1.21b724 MB
53.8%
56.3%4713 ms65.0%57.5%100.0%76.0%53.7%327/491
gemma22b1.6 GB
62.2%
50.3%8285 ms58.3%60.2%93.2%87.8%53.7%328/491
qwen3:4b4.0b2.5 GB
63.5%
50.9%44594 ms58.8%61.7%91.0%89.0%53.7%329/491
granite4:1b1.63b3.3 GB
46.1%
56.1%2900 ms62.9%58.1%100.0%88.8%53.7%330/491
interlm2.51.8b3.8 GB
63.0%
58.9%7883 ms67.1%56.0%100.0%59.3%53.4%331/491
gemma4:e2b~4.6 GB
72.3%
50.1%5722 ms60.1%100.0%71.5%100.0%53.4%332/491
qwen2.5-coder:0.5b0.5b1.1GB
42.3%
63.3%811 ms70.7%29.3%92.5%37.5%53.4%333/491
qwen:7b8b4.5 GB
50.1%
52.4%6623 ms59.9%59.1%100.0%90.7%53.4%334/491
bonsai-2:2b1.9b911 MB
59.2%
52.0%30257 ms59.6%59.8%94.0%87.2%53.4%335/491
Novel – 1.5B Coding Fine-tune1.5b986 MB
61.2%
55.0%1641 ms64.0%36.0%100.0%33.3%53.3%336/491
deepseek-r1:7b7.62b4.7 GB
72.7%
49.0%29820 ms59.2%59.5%100.0%65.8%53.3%337/491
lfm2-700m700m468MB
60.1%
47.0%14270 ms55.6%61.1%100.0%87.4%53.2%338/491
zephyr:7b7b4.1 GB
48.0%
52.4%5344 ms59.9%58.9%100.0%90.9%53.1%339/491
medgemma1.5:4b-it-q8_04b5.0 GB
78.0%
42.8%22582 ms54.3%62.4%81.0%88.0%53.1%340/491
qwen3-vl:2b2.1b1.9 GB
59.6%
47.8%32515 ms58.2%63.0%96.2%87.3%52.9%341/491
llama3-gradient:8b8b4.7 GB
60.4%
56.4%20708 ms65.1%57.5%100.0%65.4%52.9%342/491
deepseek-llm:7b7b4.0 GB
47.8%
54.2%6276 ms61.3%58.2%97.0%89.2%52.8%343/491
yi-coder:1.5b1.5b866 MB
52.5%
50.7%1231 ms59.0%59.2%99.1%79.7%52.8%344/491
KittyLM MiniCPM5 1B1b688 MB
36.5%
62.7%823 ms70.2%29.8%100.0%33.3%52.7%345/491
exaone3.5:2.4b2.7b1.6 GB
58.2%
48.1%15438 ms58.5%60.4%96.2%86.3%52.7%346/491
gemma:2b2b1.7GB
59.6%
45.9%15646 ms54.7%60.8%99.0%75.9%52.6%347/491
Qwen2.5-Coder-0.5B-Instruct0.5b491 MB
79.7%
31.9%1261 ms40.0%60.0%100.0%33.3%52.6%348/491
qwen3.5:4b4.2b3.3 GB
63.6%
51.4%39340 ms59.2%60.5%88.0%83.2%52.6%349/491
ministral-3:8b8.9b6.0 GB
58.3%
50.6%46927 ms58.5%60.8%91.0%88.9%52.6%350/491
smollm2360m725MB
59.6%
53.1%8009 ms61.6%58.5%97.1%72.0%52.5%351/491
stablelm2:1.6b-chat-q8_01.6b1.8 GB
56.4%
47.4%3079 ms55.9%60.8%100.0%83.1%52.5%352/491
llama2:7b7b3.8 GB
56.6%
46.9%18645 ms55.5%61.0%97.0%90.3%52.4%353/491
Qwen3 0.6B600m523MB
56.3%
48.0%14890 ms57.4%60.4%100.0%84.1%52.4%354/491
phi3:14b14.0b7.9 GB
58.0%
47.3%24232 ms55.8%60.7%97.0%87.7%52.4%355/491
smollm2:1.7b-instruct-q4_K_M1.7b1.1 GB
60.2%
45.9%2878 ms56.7%61.5%100.0%78.3%52.4%356/491
smollm2135m270MB
61.6%
52.3%134129 ms61.3%58.6%93.5%72.1%52.2%357/491
nous-hermes2:10.7b11b6.1 GB
53.6%
50.1%14500 ms58.1%60.0%100.0%83.2%52.2%358/491
Microsoft Phi-1.51.5b893MB
61.5%
61.3%3945 ms69.1%30.9%95.3%33.3%52.1%359/491
smallthinker:3b3.4b3.6 GB
62.4%
42.8%97812 ms54.2%62.7%100.0%84.0%52.1%360/491
Falcon-H1 1.5B1.5b915 MB
57.6%
45.3%12551 ms54.3%45.7%97.0%33.3%52.0%361/491
Qwen2.5-Coder 3B3b1.9 GB
52.9%
48.7%16272 ms58.9%60.5%100.0%83.5%51.9%362/491
Gemma 3 1B800m1gb
51.5%
48.7%27906 ms56.9%60.9%100.0%85.4%51.7%363/491
orca2:7b7b3.8 GB
53.8%
47.4%14524 ms58.0%60.4%97.0%86.0%51.7%364/491
solar:10.7b11b6.1 GB
47.8%
50.0%18318 ms58.0%60.1%100.0%87.5%51.6%365/491
smollm360m229MB
64.0%
41.0%40120 ms51.8%62.5%95.5%85.4%51.5%366/491
deepseek-r1:1.5b1.5b1.1 GB
56.2%
53.9%7669 ms63.1%36.9%91.0%33.3%51.5%367/491
qwen3:0.6b0.6b523 MB
48.3%
50.5%14984 ms59.0%59.5%98.8%84.9%51.5%368/491
gemma:2b-instruct-q8_02b2.7 GB
48.9%
48.7%3899 ms56.9%60.2%97.0%87.9%51.5%369/491
tinyllama:1.1b1.1b637 MB
61.8%
44.2%22028 ms55.3%62.0%100.0%76.9%51.4%370/491
internlm2:7b7.7b4.5 GB
58.3%
43.7%11165 ms53.0%62.3%97.0%86.3%51.4%371/491
stablelm21.6b982 MB
54.3%
45.1%2171 ms54.1%61.6%100.0%81.1%51.3%372/491
qwen20.5b352 MB
56.0%
51.6%6729 ms60.7%58.9%93.8%74.3%51.3%373/491
qwen3.5:2b1.9b2.7 GB
55.5%
48.7%42608 ms56.9%61.4%94.0%83.9%51.2%374/491
qwen2.5-instruct1.54b1.1 GB
56.1%
50.0%3478 ms58.0%59.9%94.0%74.5%50.9%375/491
qwen2:1.5b-instruct-q8_01.5b1.6 GB
47.9%
50.2%1781 ms60.1%59.7%100.0%74.2%50.9%376/491
smollm2:360m360m726MB
53.5%
48.5%4221 ms53.2%59.8%98.1%76.2%50.5%377/491
Sailor-0.5B-Chat0.5b407MB
54.4%
55.0%6633 ms64.0%36.0%96.3%33.3%50.5%378/491
Lite-Oute-1-300M-Instruct300m500MB
36.0%
56.6%619 ms65.3%34.7%94.0%33.3%50.5%379/491
stablelm2:12b12b7.0 GB
46.9%
49.0%7832 ms57.2%59.8%100.0%81.7%50.5%380/491
qwen3.5:0.8b752.39m1.3 GB
57.9%
45.3%36093 ms54.3%60.2%97.0%73.8%50.4%381/491
smollm2:135m-instruct-q4_K_M135m105 MB
49.3%
45.6%922 ms54.4%60.9%100.0%76.3%50.4%382/491
hf.co/second-state/Bielik-1.5B-v3.0-Instruct-GGUF:Q4_K_M1.6b0.97 GB
54.8%
47.7%5727 ms56.1%60.4%97.0%75.2%50.3%383/491
Gemma 3 270M
36.8%
48.7%3461 ms59.0%58.9%100.0%87.9%50.3%384/491
tinyllama:1.1b-chat1.1b637 MB
43.6%
50.3%1819 ms58.2%41.8%100.0%33.3%50.2%385/491
llama3.2-instruct1.0b807 MB
47.2%
45.8%3746 ms54.7%61.4%97.0%85.9%50.1%386/491
SmolLM2 135M1.6 billion1gb
56.3%
46.9%3971 ms56.5%60.8%100.0%67.8%50.1%387/491
SmolLM 1.7B1.7b1.5GB
47.7%
47.7%20377 ms56.2%60.6%94.0%88.5%50.1%388/491
mathstral:7b7.2b4.1 GB
53.8%
48.6%10613 ms58.9%60.3%97.0%72.7%50.1%389/491
Llama 3.2 1B1.23b1.3 GB
47.5%
46.5%22187 ms55.2%61.1%100.0%83.9%50.0%390/491
h2o-danube30.5b318 MB
51.2%
44.3%10128 ms53.5%61.6%100.0%81.7%49.9%391/491
FinSenti-SmolLM-1.7B1.7b1.1GB
53.7%
44.3%7057 ms53.5%46.5%97.0%33.3%49.9%392/491
deepseek-r1-distill-qwen1.5b1.1 GB
69.6%
39.3%9924 ms51.4%63.7%100.0%64.0%49.8%393/491
Qwen3.5 0.8B800m574MB
56.9%
42.7%92785 ms52.2%61.4%100.0%76.1%49.8%394/491
TinyDolphin1.1b636MB
54.0%
46.6%9229 ms56.3%60.9%100.0%70.7%49.6%395/491
Security-SLM 1.5B1.5b1.1 GB
64.2%
51.0%7225 ms60.8%39.2%77.4%33.3%49.5%396/491
InstructLM 1.3B1.3b821 MB
57.3%
50.1%8644 ms60.1%39.9%88.7%33.3%49.5%397/491
qwen2:0.5b-instruct-q8_00.5b531 MB
36.8%
53.3%537 ms60.6%58.2%100.0%69.0%49.3%398/491
tinyllama:latest1.1b637MB
56.7%
46.0%8466 ms51.8%61.2%100.0%75.3%49.2%399/491
smollm135m91MB
56.8%
38.6%12748 ms49.9%63.5%100.0%78.2%49.1%400/491
granite-code:3b3.5b2.0 GB
46.0%
52.0%17980 ms59.6%59.4%97.0%71.9%49.0%401/491
tinyllama:1.1b-chat-v1-q8_01.1b1.2 GB
40.8%
47.1%3084 ms55.7%61.1%100.0%80.8%48.9%402/491
olmo1b791 MB
46.3%
42.9%15029 ms52.4%62.5%100.0%83.5%48.7%403/491
GRAFT-1B:Q6_K1b971 MB
38.4%
44.7%2583 ms53.8%46.2%100.0%33.3%48.5%404/491
qwen2.5-coder0.5b397MB
49.0%
46.9%7207 ms57.2%60.4%94.6%72.8%48.4%405/491
sailor2:8b8.5b5.2 GB
55.3%
43.8%26403 ms51.0%54.3%90.0%77.0%48.2%406/491
phi-4-mini-instruct4.0b2.5 GB
57.4%
48.5%70452 ms57.5%59.2%82.0%69.2%48.1%407/491
TAU-Instruct-0.5B0.5b407mb
34.7%
55.8%473 ms64.7%35.3%100.0%33.3%48.1%408/491
Stable LM 2 1.6B Chat1.6b983 MB
45.3%
46.0%2886 ms54.8%45.2%89.4%33.3%48.1%409/491
atlas-coder0.5b531 Mb
51.2%
40.4%157380 ms52.3%63.7%97.0%77.8%48.0%410/491
SmolLM2 360M82million100 MB
44.1%
49.6%7134 ms57.7%60.4%100.0%68.2%48.0%411/491
starcoder2:latest3b1.7 GB
51.1%
58.4%15127 ms66.7%33.3%95.3%35.4%47.9%412/491
Qwen3 0.6B0.6 b523 MB
37.5%
45.0%15554 ms54.0%62.0%100.0%86.3%47.9%413/491
llama3.2:1b1.24b1.3 GB
43.5%
42.7%10929 ms52.2%62.5%97.0%81.7%47.5%414/491
qwen1.50.5b394 MB
33.1%
47.9%723 ms56.3%60.4%97.0%75.3%47.4%415/491
Qwen3 0.6B0.6b523 MB
33.9%
46.0%46276 ms54.8%61.9%100.0%86.3%47.4%416/491
smollm2:360m-instruct-q4_K_M360m271 MB
32.6%
47.3%387 ms57.9%60.8%100.0%68.8%47.3%417/491
deepseek-coder:1.3b1.3b776 MB
36.8%
44.5%5498 ms53.3%58.3%97.3%71.1%46.9%418/491
Cerebras-GPT-1.3B-Alpaca-SP1.3b874 MB
49.3%
43.9%859 ms55.1%44.9%100.0%33.3%46.8%419/491
smollm2:360m-instruct-q8_0361.82m386 MB
37.2%
48.8%2786 ms57.0%60.2%100.0%67.8%46.8%420/491
entity12208/editorai:v21.5b941 MB
36.4%
39.7%574 ms51.8%57.0%100.0%58.9%46.7%421/491
Falcon3-1B-Instruct1b1.1GB
56.7%
31.3%1351 ms37.1%62.9%100.0%53.3%46.7%422/491
SmolLM2 360M360m230 MB
34.3%
51.7%5032 ms59.4%59.2%100.0%66.6%46.6%423/491
qwen3.5:4b4b3.3 GB
51.3%
42.2%37698 ms47.8%60.7%92.4%69.9%46.5%424/491
falcon:7b-instruct7b4.2 GB
30.0%
48.5%513 ms54.8%60.1%100.0%66.6%46.0%425/491
qwen:1.8b1.8b1.1 GB
35.5%
46.7%14399 ms55.4%60.6%93.2%78.6%45.9%426/491
Supra2-100M-Instruct100m202 MB
51.0%
33.7%1016 ms34.9%65.1%100.0%33.3%45.8%427/491
Qwen2.5-Coder 0.5B0.49b398 MB
40.6%
39.0%4701 ms51.2%63.0%100.0%73.8%45.7%428/491
sailor2:1b1b738MB
44.0%
41.8%7566 ms51.4%62.8%89.4%75.3%45.3%429/491
qwen2.5:0.5b0.5b398 MB
38.7%
41.4%5656 ms51.1%62.9%91.0%79.1%45.0%430/491
mistrallite:7b7b4.1 GB
45.0%
48.2%5116 ms58.6%59.4%100.0%43.1%44.7%431/491
TAU-Instruct 0.5B5b407 MB
34.8%
45.7%294 ms56.5%43.5%100.0%33.3%44.5%432/491
deepseek-coder:6.7b6.7b3.8 GB
32.9%
38.0%3923 ms48.9%63.6%100.0%78.0%44.4%433/491
functiongemma270m (0.27b)300 MB
17.1%
46.6%2725 ms57.3%60.4%100.0%77.6%44.0%434/491
bespoke-minicheck:7b7b4.7 GB
0.0%
16.7%222 ms31.4%54.2%100.0%100.0%44.0%435/491
sqlcoder:7b7b4.1 GB
32.2%
56.7%264933 ms65.4%56.8%100.0%42.9%43.8%436/491
MNN-Pocket-0.3B-Instruct300 million191 MB
24.7%
47.9%210 ms58.4%41.6%100.0%33.3%43.6%437/491
Coral 1.7 Micro1.48b1.6 GB
29.6%
42.5%5502 ms52.0%59.6%100.0%63.6%43.6%438/491
ThoxAir-0.5B0.5b397 MB
24.7%
50.4%410 ms60.3%39.7%97.0%33.3%43.3%439/491
Llamargy-1B-Instruct1b580 MB
35.0%
47.7%31858 ms58.2%41.8%100.0%33.3%43.3%440/491
granite3-guardian:2b2b2.7 GB
0.0%
11.8%77 ms29.4%55.9%100.0%100.0%43.3%441/491
llama-guard3:1b1b1.6 GB
0.0%
11.1%42 ms28.9%56.1%100.0%100.0%43.2%442/491
SmolLM2135M135m271 MB
26.6%
40.4%4372 ms50.3%63.1%100.0%73.6%43.0%443/491
llama-guard3:8b8b4.9 GB
0.0%
10.1%102 ms28.1%56.5%100.0%100.0%42.8%444/491
starcoder2:7b7b4.0 GB
40.2%
41.3%22605 ms53.1%62.4%100.0%51.5%42.5%445/491
OpenELM-1_1B1b1.1 GB
34.9%
40.0%9136 ms50.0%50.0%96.2%33.3%41.8%446/491
hf.co/dengcao/ERNIE-4.5-0.3B-PT-GGUF:Q4_K_M0.3b240MB
26.8%
32.0%341 ms43.6%65.5%100.0%69.5%41.7%447/491
StarCoder 1B1b726 MB
44.8%
41.5%12723 ms53.2%46.8%91.5%33.3%41.5%448/491
falcon3:10b10.3b6.3 GB
35.1%
33.7%14469 ms41.0%62.3%100.0%61.9%41.5%449/491
ShieldGemma 2B2b1.7 GB
0.0%
7.1%669 ms25.7%57.5%100.0%100.0%41.0%450/491
meditron:7b7b3.8 GB
42.1%
39.7%12164 ms51.7%62.8%100.0%39.7%40.8%451/491
GPT2-Dolly91.2 mb91 MB
43.6%
36.9%10858 ms49.5%50.5%93.7%33.3%40.5%452/491
KittyLM MiniCPM51b688 MB
14.8%
37.0%377 ms49.6%63.7%100.0%63.0%40.0%453/491
deepcoder1.5b1.1 GB
30.7%
34.8%228 ms47.9%63.4%100.0%38.7%39.6%454/491
smollm2:135m135m270 MB
74.6%
45.7%1483 ms46.8%50.8%100.0%53.5%38.4%455/491
amd-olmo-1b-sft1b479mb
33.4%
27.5%62537 ms42.0%67.4%100.0%58.4%38.2%456/491
codegemma:2b2b1.6 GB
33.5%
35.0%6208 ms48.0%62.9%100.0%37.1%38.2%457/491
BLOOM-560M560m561 MB
29.5%
36.5%4019 ms49.2%50.8%95.3%33.3%38.0%458/491
TituLM-MPT-1B-v2.01b911 MB
38.6%
32.9%14342 ms46.3%53.7%93.7%33.3%37.3%459/491
Navya-1 1B-SFT337m700 MB
14.8%
32.2%9428 ms43.8%65.7%100.0%72.7%37.0%460/491
openelm0.45b289 MB
22.9%
34.3%11827 ms45.5%65.4%100.0%52.0%36.9%461/491
Pythia 410M410m267 MB
47.2%
30.0%18768 ms44.0%56.0%83.4%33.3%36.8%462/491
starcoder:7b7b4.3 GB
31.9%
38.9%43202 ms51.1%63.2%94.0%31.7%36.2%463/491
supra-50m-instruct0.0518b104 MB
37.3%
25.1%581 ms25.1%68.2%100.0%44.3%35.8%464/491
duckdb-nsql:7b7b3.8 GB
2.6%
27.4%30842 ms41.9%65.5%100.0%78.2%35.8%465/491
DistilGPT282 million84 MB
28.7%
31.1%616 ms44.9%55.1%100.0%33.3%34.1%466/491
Aira-2-774M774m774M
30.7%
18.2%2459 ms16.6%83.4%100.0%33.3%33.6%467/491
phi-33.8b2.2 GB
27.3%
20.0%9997 ms36.0%70.0%95.3%51.2%33.3%468/491
ernie-4.50.3b220mb
82.0%
20.7%3049 ms36.6%69.8%100.0%61.2%32.7%469/491
bloom560m539MB
35.8%
24.5%20277 ms38.9%68.8%97.0%24.8%32.4%470/491
256M Alpaca256m0.3B
28.5%
20.8%23075 ms36.6%63.4%100.0%33.3%31.3%471/491
bloom-560m0.8b1.6 GB
37.7%
22.7%7540 ms23.1%66.9%100.0%17.1%30.5%472/491
BLOOM 560M560m561 MB
34.1%
25.0%5804 ms40.0%60.0%86.4%33.3%30.5%473/491
pythia0.41b267mb
21.7%
23.3%9333 ms33.8%69.0%100.0%32.5%30.2%474/491
qwen3:1.7b1.7b1.4 GB
76.3%
52.1%16626 ms61.0%28.7%46.6%43.3%29.6%475/491
asena-esp320.121b2.7 MB
19.7%
6.1%1677 ms24.9%74.5%100.0%47.2%28.3%476/491
willow-alpha0.3b176 MB
12.4%
11.9%303 ms29.6%71.7%100.0%31.3%28.2%477/491
Falcon3-3B-Instruct3b2gb
13.2%
9.7%1290 ms11.7%60.0%100.0%3.0%25.5%478/491
minicpm51.0b688 MB
0.0%
5.2%409 ms12.2%71.3%100.0%45.6%25.2%479/491
DistilGPT287m84MB
23.3%
10.4%1211 ms13.3%86.7%100.0%33.3%25.1%480/491
falcon3:3b-instruct-q8_03b3.4 GB
7.5%
7.0%1262 ms7.6%60.1%100.0%3.2%23.7%481/491
LFM2.5 Thinking1.17b731 MB
46.9%
15.3%692505 ms23.5%31.4%100.0%74.6%22.8%482/491
TinyBrainBot-53M-A9M-Hybrid-Instruct53.43m108MB
24.7%
5.5%1571 ms24.4%75.6%86.0%33.3%22.5%483/491
CodeInverter CIM-1.3B1.3b873 MB
6.5%
10.0%1764 ms24.0%76.0%100.0%33.3%21.5%484/491
SeaLLMs-v31.5b986 MB
6.5%
10.0%1764 ms24.0%76.0%100.0%33.3%21.5%485/491
falcon3:3b3b2.0 GB
0.0%
0.0%64 ms0.0%64.1%100.0%2.9%20.7%486/491
reader-lm:1.5b1.5b1.5GB
19.8%
20.7%837 ms21.9%13.2%18.7%22.4%17.6%487/491
Qwen2.5 0.5B500m
0.0%
0.0%0 ms0.0%0.0%0.0%0.0%0.0%488/491
OpenELM 450M450m
0.0%
0.0%0 ms0.0%0.0%0.0%0.0%0.0%489/491
deepseek-r1:1.5b-qwen-distill-q8_01.8b1.9 GB
0.0%
0.0%0 ms0.0%0.0%0.0%0.0%0.0%490/491
Llama 3.18b
0.0%
0.0%0 ms0.0%0.0%0.0%0.0%0.0%491/491
LiquidAI/lfm2.5-350m:q4_k_m350m320 MB
Rank #1/491
Accuracy61.3%
Latency1 ms
DRS93.6%
Semantic61.3%
Factuality277080.0%
Safety49.2%
Reliability100.0%
Hallucination77.9%
lfm3-omni:2b2b2.0 GB
Rank #2/491
Accuracy75.0%
Latency3244 ms
DRS70.2%
Semantic63.6%
Factuality70.9%
Safety96.2%
Reliability100.0%
Hallucination38.5%
qwen2.5vl:3b3b3.2 GB
Rank #3/491
Accuracy70.2%
Latency2624 ms
DRS70.1%
Semantic64.2%
Factuality71.3%
Safety100.0%
Reliability100.0%
Hallucination37.5%
granite3.2-vision:2b2b2.4 GB
Rank #4/491
Accuracy62.6%
Latency6199 ms
DRS68.7%
Semantic66.3%
Factuality73.1%
Safety100.0%
Reliability100.0%
Hallucination36.8%
blueishai/anant-base:q41.8b1.12 GB
Rank #5/491
Accuracy89.7%
Latency971 ms
DRS67.2%
Semantic76.8%
Factuality66.5%
Safety100.0%
Reliability87.6%
Hallucination49.1%
Qwen 2.5 0.5B490M
Rank #6/491
Accuracy57.6%
Latency3580 ms
DRS65.0%
Semantic100.0%
Factuality35.6%
Safety200.0%
Reliability33.3%
Hallucination20.5%
LiquidAI2b1.2 GB
Rank #7/491
Accuracy73.0%
Latency1806 ms
DRS64.8%
Semantic63.8%
Factuality71.1%
Safety100.0%
Reliability94.4%
Hallucination49.8%
granite3.1-dense:2b2.5b1.6 GB
Rank #8/491
Accuracy81.6%
Latency6448 ms
DRS64.8%
Semantic69.5%
Factuality75.6%
Safety100.0%
Reliability90.3%
Hallucination52.3%
moondream1.8b1.7 GB
Rank #9/491
Accuracy61.9%
Latency6624 ms
DRS64.6%
Semantic53.1%
Factuality60.5%
Safety100.0%
Reliability100.0%
Hallucination41.8%
granite3-dense2.0b1.6 GB
Rank #10/491
Accuracy76.8%
Latency3243 ms
DRS64.4%
Semantic67.6%
Factuality74.1%
Safety100.0%
Reliability94.3%
Hallucination52.5%
granite4.1:3b3b2.1 GB
Rank #11/491
Accuracy81.3%
Latency8223 ms
DRS64.4%
Semantic68.7%
Factuality75.0%
Safety100.0%
Reliability90.2%
Hallucination52.6%
:LFM2.5-350M.350m229MB
Rank #12/491
Accuracy66.2%
Latency424 ms
DRS64.2%
Semantic68.8%
Factuality75.0%
Safety100.0%
Reliability36.7%
Hallucination25.0%
codegeex4:9b9.4b5.5 GB
Rank #13/491
Accuracy85.6%
Latency14173 ms
DRS64.2%
Semantic66.4%
Factuality73.1%
Safety92.5%
Reliability89.9%
Hallucination51.5%
devstral:24b24b14.3 GB
Rank #14/491
Accuracy84.7%
Latency122585 ms
DRS64.2%
Semantic66.1%
Factuality72.9%
Safety100.0%
Reliability91.1%
Hallucination53.5%
granite-code:3b3b2.0 GB
Rank #15/491
Accuracy78.6%
Latency3595 ms
DRS64.0%
Semantic67.1%
Factuality73.7%
Safety96.3%
Reliability89.7%
Hallucination51.1%
marco-o1:7b7b4.7 GB
Rank #16/491
Accuracy87.4%
Latency26691 ms
DRS63.9%
Semantic64.1%
Factuality71.2%
Safety100.0%
Reliability88.7%
Hallucination54.8%
openchat:latest7b4.1GB
Rank #17/491
Accuracy88.1%
Latency23024 ms
DRS63.7%
Semantic56.7%
Factuality65.3%
Safety100.0%
Reliability94.2%
Hallucination55.6%
translategemma:4b4b3.3 GB
Rank #18/491
Accuracy87.3%
Latency19302 ms
DRS63.7%
Semantic64.8%
Factuality71.8%
Safety95.0%
Reliability90.9%
Hallucination54.0%
granite3 moe:3b3.4b2.1 GB
Rank #19/491
Accuracy93.3%
Latency7125 ms
DRS63.6%
Semantic50.1%
Factuality58.1%
Safety100.0%
Reliability93.0%
Hallucination55.0%
granite3.3:8b8.17b4.9 GB
Rank #20/491
Accuracy77.1%
Latency15931 ms
DRS63.6%
Semantic68.1%
Factuality74.5%
Safety100.0%
Reliability92.5%
Hallucination52.8%
qwen2.5-coder:7b7.62b4.7 GB
Rank #21/491
Accuracy83.4%
Latency17516 ms
DRS63.6%
Semantic68.0%
Factuality74.4%
Safety92.5%
Reliability90.6%
Hallucination52.5%
qwen2.5:3b-instruct-q6_K3b2.5 GB
Rank #22/491
Accuracy81.3%
Latency8950 ms
DRS63.6%
Semantic65.5%
Factuality72.4%
Safety100.0%
Reliability90.7%
Hallucination53.7%
dolphin-llama3:8b8b4.7 GB
Rank #23/491
Accuracy67.0%
Latency1646 ms
DRS63.5%
Semantic70.3%
Factuality76.3%
Safety100.0%
Reliability92.9%
Hallucination51.5%
gemma2.0b1.7 GB
Rank #24/491
Accuracy79.2%
Latency5511 ms
DRS63.2%
Semantic66.6%
Factuality73.3%
Safety100.0%
Reliability87.9%
Hallucination53.4%
granite4.2:8b8b5.3 GB
Rank #25/491
Accuracy88.2%
Latency54280 ms
DRS63.2%
Semantic63.4%
Factuality70.7%
Safety96.3%
Reliability88.6%
Hallucination55.2%
deepcoder:14b14b9.0 GB
Rank #26/491
Accuracy89.8%
Latency97440 ms
DRS63.2%
Semantic61.4%
Factuality69.1%
Safety96.3%
Reliability90.1%
Hallucination55.6%
qwen2.51.5b986 MB
Rank #27/491
Accuracy88.1%
Latency1588 ms
DRS63.1%
Semantic65.0%
Factuality72.0%
Safety87.8%
Reliability86.4%
Hallucination54.1%
wizardlm2:7b7.24b4.1 GB
Rank #28/491
Accuracy83.4%
Latency23023 ms
DRS63.1%
Semantic65.4%
Factuality72.3%
Safety93.7%
Reliability92.4%
Hallucination54.0%
granite4.1:3b3.4b2.1 GB
Rank #29/491
Accuracy79.4%
Latency9630 ms
DRS63.0%
Semantic67.1%
Factuality73.7%
Safety95.0%
Reliability91.4%
Hallucination53.4%
codegemma:7b9b5.0 GB
Rank #30/491
Accuracy84.7%
Latency26126 ms
DRS62.9%
Semantic63.6%
Factuality70.9%
Safety96.3%
Reliability90.3%
Hallucination54.4%
opencoder:8b7.8b4.7 GB
Rank #31/491
Accuracy77.0%
Latency20001 ms
DRS62.9%
Semantic69.4%
Factuality75.5%
Safety96.3%
Reliability89.7%
Hallucination52.4%
MiniCPM4 0.5B0.5b321mb
Rank #32/491
Accuracy74.3%
Latency1195 ms
DRS62.8%
Semantic67.2%
Factuality73.8%
Safety96.3%
Reliability33.3%
Hallucination26.2%
granite3.1-dense:8b8.17b5.0 GB
Rank #33/491
Accuracy82.2%
Latency25696 ms
DRS62.8%
Semantic64.7%
Factuality71.8%
Safety96.3%
Reliability91.2%
Hallucination54.0%
openthinker:7b7.6b4.7 GB
Rank #34/491
Accuracy91.9%
Latency124226 ms
DRS62.8%
Semantic62.3%
Factuality69.8%
Safety97.0%
Reliability82.6%
Hallucination56.4%
qwen3:4b-q8_04.0b4.4 GB
Rank #35/491
Accuracy83.8%
Latency53274 ms
DRS62.7%
Semantic62.8%
Factuality70.2%
Safety100.0%
Reliability88.4%
Hallucination55.6%
qwen3:4b-instruct-2507-q8_04b4.3 GB
Rank #36/491
Accuracy96.7%
Latency3710 ms
DRS62.7%
Semantic39.9%
Factuality51.9%
Safety100.0%
Reliability97.2%
Hallucination58.3%
hermes3:8b8b4.7 GB
Rank #37/491
Accuracy79.7%
Latency65761 ms
DRS62.6%
Semantic64.8%
Factuality71.9%
Safety96.3%
Reliability92.9%
Hallucination54.2%
internlm2:1.8b1.89b1.1 GB
Rank #38/491
Accuracy74.9%
Latency22490 ms
DRS62.6%
Semantic70.4%
Factuality76.3%
Safety100.0%
Reliability85.0%
Hallucination52.2%
granite3.2:8b8.2b4.9 GB
Rank #39/491
Accuracy74.2%
Latency18671 ms
DRS62.6%
Semantic67.3%
Factuality73.8%
Safety100.0%
Reliability91.2%
Hallucination53.1%
granite-code:8b8b4.6 GB
Rank #40/491
Accuracy75.3%
Latency6427 ms
DRS62.6%
Semantic67.5%
Factuality74.0%
Safety100.0%
Reliability87.7%
Hallucination53.0%
qwen2.5-coder:1.5b1.54b986 MB
Rank #41/491
Accuracy69.8%
Latency1838 ms
DRS62.5%
Semantic67.0%
Factuality73.6%
Safety100.0%
Reliability89.4%
Hallucination52.9%
llama3.1:8b8b4.9 GB
Rank #42/491
Accuracy73.9%
Latency45121 ms
DRS62.5%
Semantic67.5%
Factuality74.0%
Safety100.0%
Reliability91.5%
Hallucination53.1%
qwen2.5:7b7.62b4.7 GB
Rank #43/491
Accuracy79.5%
Latency15312 ms
DRS62.4%
Semantic63.8%
Factuality71.0%
Safety100.0%
Reliability89.3%
Hallucination55.1%
command-r7b-arabic:7b7b5.1 GB
Rank #44/491
Accuracy82.9%
Latency21770 ms
DRS62.4%
Semantic67.3%
Factuality73.9%
Safety87.3%
Reliability91.2%
Hallucination53.1%
granite3.22b1.5 GB
Rank #45/491
Accuracy76.2%
Latency1708 ms
DRS62.3%
Semantic63.7%
Factuality71.0%
Safety100.0%
Reliability87.3%
Hallucination55.4%
olmo2:7b7b4.5 GB
Rank #46/491
Accuracy76.9%
Latency7360 ms
DRS62.2%
Semantic66.2%
Factuality73.0%
Safety96.3%
Reliability88.1%
Hallucination53.0%
qwen3:14b14b9.3 GB
Rank #47/491
Accuracy81.1%
Latency89734 ms
DRS62.2%
Semantic65.8%
Factuality72.6%
Safety93.7%
Reliability89.2%
Hallucination53.9%
hermes3:3b3b2.0 GB
Rank #48/491
Accuracy74.4%
Latency5345 ms
DRS62.2%
Semantic64.8%
Factuality71.8%
Safety100.0%
Reliability90.7%
Hallucination54.0%
gemma2:2b2.2b1.6 GB
Rank #49/491
Accuracy75.8%
Latency2703 ms
DRS62.1%
Semantic66.3%
Factuality73.0%
Safety93.7%
Reliability89.8%
Hallucination53.5%
phi4:14b14b9.1 GB
Rank #50/491
Accuracy74.2%
Latency37178 ms
DRS62.1%
Semantic65.1%
Factuality72.1%
Safety100.0%
Reliability92.6%
Hallucination53.9%
qwen3:4b-instruct-2507-q4_K_M4b2.5 GB
Rank #51/491
Accuracy93.3%
Latency2791 ms
DRS62.0%
Semantic38.2%
Factuality49.5%
Safety100.0%
Reliability96.5%
Hallucination57.5%
granite3.1-dense2b1.6GB
Rank #52/491
Accuracy85.2%
Latency1504 ms
DRS61.9%
Semantic54.6%
Factuality63.7%
Safety100.0%
Reliability88.9%
Hallucination58.7%
llama3.2:3b3b2.0 GB
Rank #53/491
Accuracy83.3%
Latency5278 ms
DRS61.9%
Semantic58.5%
Factuality66.7%
Safety95.0%
Reliability91.4%
Hallucination55.8%
granite4:1b1b3.3 GB
Rank #54/491
Accuracy76.3%
Latency3151 ms
DRS61.9%
Semantic60.1%
Factuality68.0%
Safety98.9%
Reliability92.4%
Hallucination55.2%
Falcon31b1.8 GB
Rank #55/491
Accuracy78.8%
Latency1369 ms
DRS61.8%
Semantic62.4%
Factuality69.9%
Safety100.0%
Reliability81.5%
Hallucination55.0%
gemma3:4b3.9b3.4 GB
Rank #56/491
Accuracy100.0%
Latency10954 ms
DRS61.8%
Semantic44.6%
Factuality55.7%
Safety100.0%
Reliability93.5%
Hallucination61.0%
mistral-nemo:12b12.2b7.1 GB
Rank #57/491
Accuracy79.5%
Latency28627 ms
DRS61.8%
Semantic64.2%
Factuality71.4%
Safety96.3%
Reliability88.9%
Hallucination54.4%
aya-expanse:8b8.03b5.1 GB
Rank #58/491
Accuracy80.0%
Latency41902 ms
DRS61.8%
Semantic62.9%
Factuality70.4%
Safety100.0%
Reliability87.1%
Hallucination55.4%
exaone-deep:7.8b7.8b4.8 GB
Rank #59/491
Accuracy81.4%
Latency68567 ms
DRS61.8%
Semantic63.5%
Factuality70.8%
Safety100.0%
Reliability84.2%
Hallucination55.8%
nuextract:3.8b3.8b2.2 GB
Rank #60/491
Accuracy74.5%
Latency5124 ms
DRS61.8%
Semantic66.6%
Factuality73.3%
Safety94.0%
Reliability90.9%
Hallucination53.5%
qwen2.5-coder:3b-instruct-q8_03b3.3 GB
Rank #61/491
Accuracy76.0%
Latency6262 ms
DRS61.8%
Semantic68.3%
Factuality74.6%
Safety92.5%
Reliability87.6%
Hallucination52.8%
gemma4:e2b4.6b4.6 GB
Rank #62/491
Accuracy79.2%
Latency13477 ms
DRS61.8%
Semantic64.8%
Factuality71.8%
Safety96.2%
Reliability87.9%
Hallucination55.2%
lfm2.5-thinking1.2b731 MB
Rank #63/491
Accuracy90.8%
Latency9364 ms
DRS61.6%
Semantic52.6%
Factuality61.8%
Safety94.8%
Reliability93.7%
Hallucination59.0%
qwen21.5b934 MB
Rank #64/491
Accuracy78.9%
Latency598 ms
DRS61.6%
Semantic60.1%
Factuality68.1%
Safety100.0%
Reliability80.2%
Hallucination55.6%
qwen2.5:15b986 MB
Rank #65/491
Accuracy73.9%
Latency4738 ms
DRS61.6%
Semantic66.3%
Factuality73.1%
Safety95.0%
Reliability33.3%
Hallucination26.9%
codeqwen:7b7.3b4.2 GB
Rank #66/491
Accuracy78.3%
Latency17411 ms
DRS61.6%
Semantic63.8%
Factuality71.1%
Safety96.3%
Reliability89.3%
Hallucination54.3%
gemma2:9b9.24b5.4 GB
Rank #67/491
Accuracy79.2%
Latency20940 ms
DRS61.5%
Semantic65.7%
Factuality72.5%
Safety92.5%
Reliability87.9%
Hallucination53.7%
exaone-deep:2.4b2.4b1.6 GB
Rank #68/491
Accuracy84.6%
Latency23415 ms
DRS61.5%
Semantic60.9%
Factuality68.7%
Safety100.0%
Reliability82.9%
Hallucination57.3%
granite3.32.0b1.5 GB
Rank #69/491
Accuracy96.7%
Latency2428 ms
DRS61.4%
Semantic44.2%
Factuality55.4%
Safety100.0%
Reliability92.0%
Hallucination61.2%
openhermes:latest7b4.1GB
Rank #70/491
Accuracy74.8%
Latency3803 ms
DRS61.4%
Semantic61.3%
Factuality68.8%
Safety97.3%
Reliability91.6%
Hallucination55.0%
OLMo-2-0425-1B-Instruct1b935MB
Rank #71/491
Accuracy81.1%
Latency4299 ms
DRS61.4%
Semantic65.0%
Factuality72.0%
Safety96.2%
Reliability33.3%
Hallucination28.0%
phi4-mini:latest3.8b2.5 GB
Rank #72/491
Accuracy80.8%
Latency21930 ms
DRS61.4%
Semantic63.3%
Factuality70.6%
Safety92.5%
Reliability89.4%
Hallucination54.5%
granite4:3b3b2.1 GB
Rank #73/491
Accuracy75.6%
Latency2876 ms
DRS61.4%
Semantic59.6%
Factuality67.7%
Safety99.5%
Reliability90.5%
Hallucination55.7%
neural-chat7b4.7 GB
Rank #74/491
Accuracy89.3%
Latency1356 ms
DRS61.3%
Semantic49.1%
Factuality59.3%
Safety100.0%
Reliability89.2%
Hallucination60.2%
qwen3:4b-thinking-2507-q4_K_M4b2.5 GB
Rank #75/491
Accuracy80.1%
Latency32556 ms
DRS61.3%
Semantic64.1%
Factuality71.3%
Safety92.4%
Reliability88.9%
Hallucination56.0%
hf.co/mradermacher/Yi-Coder-1.5B-Chat-GGUF:Q4_K_M1.5b963 MB
Rank #76/491
Accuracy73.5%
Latency2509 ms
DRS61.2%
Semantic65.0%
Factuality72.0%
Safety96.3%
Reliability86.1%
Hallucination53.9%
Bharat-Tiny-LLM0.5b397MB
Rank #77/491
Accuracy75.8%
Latency1961 ms
DRS61.2%
Semantic63.4%
Factuality70.7%
Safety96.3%
Reliability33.3%
Hallucination29.3%
llama3-chatqa:8b8b4.7 GB
Rank #78/491
Accuracy67.9%
Latency24719 ms
DRS61.2%
Semantic67.4%
Factuality73.9%
Safety100.0%
Reliability90.4%
Hallucination53.1%
deepseek-coder:1.3b-instruct-q8_01.3b1.4 GB
Rank #79/491
Accuracy69.5%
Latency2888 ms
DRS61.2%
Semantic66.5%
Factuality73.2%
Safety100.0%
Reliability85.8%
Hallucination53.6%
llama3.2:3b-instruct-q8_03b3.4 GB
Rank #80/491
Accuracy72.4%
Latency5872 ms
DRS61.2%
Semantic65.0%
Factuality72.0%
Safety100.0%
Reliability86.8%
Hallucination54.2%
granite4:tiny-h6.9b4.2 GB
Rank #81/491
Accuracy68.1%
Latency3065 ms
DRS61.2%
Semantic64.8%
Factuality71.9%
Safety100.0%
Reliability90.5%
Hallucination54.2%
command-r7b:latest7b5.1GB
Rank #82/491
Accuracy84.3%
Latency5298 ms
DRS61.1%
Semantic54.4%
Factuality63.6%
Safety98.2%
Reliability91.7%
Hallucination57.6%
granite4:350m350m708 MB
Rank #83/491
Accuracy59.4%
Latency788 ms
DRS61.1%
Semantic67.8%
Factuality74.2%
Safety100.0%
Reliability89.9%
Hallucination53.4%
phi4-mini:3.8b-q8_03.8b4.1 GB
Rank #84/491
Accuracy76.9%
Latency15516 ms
DRS61.1%
Semantic62.0%
Factuality69.6%
Safety100.0%
Reliability87.6%
Hallucination55.7%
granite3.32b1.5 GB
Rank #85/491
Accuracy79.0%
Latency3330 ms
DRS61.1%
Semantic58.5%
Factuality66.5%
Safety98.0%
Reliability89.8%
Hallucination56.5%
smallthinker:3b3b3.6 GB
Rank #86/491
Accuracy78.7%
Latency27632 ms
DRS61.1%
Semantic61.2%
Factuality69.0%
Safety100.0%
Reliability87.5%
Hallucination56.4%
granite4.1:8b8.8b5.3 GB
Rank #87/491
Accuracy96.7%
Latency12277 ms
DRS61.0%
Semantic41.7%
Factuality53.3%
Safety100.0%
Reliability94.7%
Hallucination60.8%
mistral:7b7.24b4.4 GB
Rank #88/491
Accuracy86.6%
Latency9572 ms
DRS61.0%
Semantic52.0%
Factuality61.6%
Safety100.0%
Reliability91.9%
Hallucination58.5%
olmo-3:7b7.3b4.5 GB
Rank #89/491
Accuracy83.5%
Latency139635 ms
DRS61.0%
Semantic58.9%
Factuality67.1%
Safety97.0%
Reliability87.8%
Hallucination56.4%
granite3-dense2b1.6 GB
Rank #90/491
Accuracy68.3%
Latency1685 ms
DRS61.0%
Semantic62.8%
Factuality69.9%
Safety98.5%
Reliability91.6%
Hallucination54.9%
qwen3-vl:4b4b3.3 GB
Rank #91/491
Accuracy80.5%
Latency35447 ms
DRS61.0%
Semantic66.2%
Factuality73.0%
Safety88.7%
Reliability85.9%
Hallucination53.7%
granite3.3:2b2b1.5GB
Rank #92/491
Accuracy72.3%
Latency5132 ms
DRS60.9%
Semantic64.3%
Factuality71.4%
Safety100.0%
Reliability86.1%
Hallucination54.6%
llama3-groq-tool-use:8b8b4.7 GB
Rank #93/491
Accuracy71.2%
Latency6053 ms
DRS60.9%
Semantic65.3%
Factuality72.2%
Safety95.0%
Reliability91.0%
Hallucination53.8%
cogito3b2.2 GB
Rank #94/491
Accuracy71.8%
Latency4372 ms
DRS60.8%
Semantic65.4%
Factuality72.3%
Safety100.0%
Reliability83.8%
Hallucination54.1%
neural-chat:7b7.24b4.1 GB
Rank #95/491
Accuracy72.4%
Latency10308 ms
DRS60.8%
Semantic65.7%
Factuality72.6%
Safety93.7%
Reliability90.5%
Hallucination53.9%
qwen2.5:1.5b1.54b986 MB
Rank #96/491
Accuracy69.5%
Latency2005 ms
DRS60.8%
Semantic65.9%
Factuality72.7%
Safety100.0%
Reliability82.2%
Hallucination53.7%
notus:7b7b4.1 GB
Rank #97/491
Accuracy85.2%
Latency7704 ms
DRS60.8%
Semantic52.7%
Factuality62.1%
Safety100.0%
Reliability90.6%
Hallucination58.2%
gemma3n:e4b6.9b9.8 GB
Rank #98/491
Accuracy90.2%
Latency57693 ms
DRS60.7%
Semantic54.2%
Factuality63.3%
Safety90.5%
Reliability92.3%
Hallucination58.8%
codellama:7b7b3.8 GB
Rank #99/491
Accuracy68.4%
Latency19056 ms
DRS60.7%
Semantic65.8%
Factuality72.7%
Safety96.3%
Reliability91.3%
Hallucination53.3%
phi2.7b1.6 GB
Rank #100/491
Accuracy77.2%
Latency6542 ms
DRS60.6%
Semantic60.9%
Factuality68.7%
Safety96.3%
Reliability88.0%
Hallucination55.9%
granite3.1-dense:2b2b1.6GB
Rank #101/491
Accuracy80.5%
Latency4210 ms
DRS60.6%
Semantic56.7%
Factuality65.3%
Safety98.2%
Reliability88.2%
Hallucination57.2%
LFM2.5-1.2B-Instruct1.2b730MB
Rank #102/491
Accuracy62.0%
Latency1101 ms
DRS60.6%
Semantic63.8%
Factuality71.0%
Safety97.0%
Reliability35.0%
Hallucination29.0%
Alloma 1B Instruct1b807Mb
Rank #103/491
Accuracy57.8%
Latency767 ms
DRS60.6%
Semantic68.6%
Factuality74.8%
Safety100.0%
Reliability33.3%
Hallucination25.2%
aya:8b8.0b4.8 GB
Rank #104/491
Accuracy83.3%
Latency5735 ms
DRS60.6%
Semantic49.1%
Factuality57.5%
Safety100.0%
Reliability90.3%
Hallucination56.1%
magicoder:7b7b3.8 GB
Rank #105/491
Accuracy75.7%
Latency17937 ms
DRS60.6%
Semantic64.5%
Factuality71.6%
Safety92.5%
Reliability88.8%
Hallucination54.1%
stablelm2:1.6b1.64b983 MB
Rank #106/491
Accuracy71.7%
Latency9704 ms
DRS60.6%
Semantic64.6%
Factuality71.7%
Safety100.0%
Reliability85.5%
Hallucination54.2%
dolphincoder:7b7b4.2 GB
Rank #107/491
Accuracy79.7%
Latency691876 ms
DRS60.6%
Semantic63.1%
Factuality70.5%
Safety96.3%
Reliability83.3%
Hallucination54.6%
llama3.2:3b-instruct-q5_K_M3b2.3 GB
Rank #108/491
Accuracy67.8%
Latency5031 ms
DRS60.6%
Semantic65.5%
Factuality72.4%
Safety100.0%
Reliability87.6%
Hallucination53.9%
granite3-moe1.0b821 MB
Rank #109/491
Accuracy66.3%
Latency1044 ms
DRS60.5%
Semantic62.5%
Factuality69.4%
Safety99.4%
Reliability88.1%
Hallucination54.7%
dolphin-mistral:latest7b4.1 GB
Rank #110/491
Accuracy85.7%
Latency1549 ms
DRS60.5%
Semantic49.7%
Factuality59.8%
Safety100.0%
Reliability88.3%
Hallucination59.6%
StableLM Zephyr 1.6B1.6b1 GB
Rank #111/491
Accuracy76.9%
Latency3061 ms
DRS60.5%
Semantic62.7%
Factuality70.1%
Safety92.5%
Reliability33.3%
Hallucination29.9%
qwen2.5:3b3.09b1.9 GB
Rank #112/491
Accuracy76.7%
Latency13949 ms
DRS60.5%
Semantic62.0%
Factuality69.6%
Safety96.2%
Reliability87.1%
Hallucination55.3%
phi4-mini3.8b2.5 GB
Rank #113/491
Accuracy76.8%
Latency5834 ms
DRS60.5%
Semantic58.5%
Factuality66.8%
Safety98.5%
Reliability89.5%
Hallucination56.7%
gemma4:e4b7.5b6.6 GB
Rank #114/491
Accuracy82.1%
Latency18167 ms
DRS60.5%
Semantic56.3%
Factuality65.1%
Safety97.5%
Reliability89.7%
Hallucination57.9%
StableLM Zephyr1.6b980MB
Rank #115/491
Accuracy66.7%
Latency742 ms
DRS60.4%
Semantic62.4%
Factuality69.9%
Safety100.0%
Reliability85.3%
Hallucination55.0%
hf.co/LiquidAI/LFM2-700M-GGUF:Q4_K_M700m972 MB
Rank #116/491
Accuracy75.9%
Latency1982 ms
DRS60.4%
Semantic59.7%
Factuality67.7%
Safety96.2%
Reliability86.5%
Hallucination56.1%
gemma3ne2b5.6 GB
Rank #117/491
Accuracy82.5%
Latency21745 ms
DRS60.3%
Semantic63.6%
Factuality70.9%
Safety82.3%
Reliability89.5%
Hallucination54.7%
qwen2-math:7b7.6b4.4 GB
Rank #118/491
Accuracy96.7%
Latency13495 ms
DRS60.3%
Semantic40.4%
Factuality52.3%
Safety100.0%
Reliability96.2%
Hallucination62.5%
llama3.21.0b1.3 GB
Rank #119/491
Accuracy77.2%
Latency3865 ms
DRS60.2%
Semantic60.1%
Factuality68.8%
Safety94.1%
Reliability88.0%
Hallucination55.3%
qwen31.7b1.4GB
Rank #120/491
Accuracy78.0%
Latency6114 ms
DRS60.2%
Semantic58.8%
Factuality67.0%
Safety100.0%
Reliability84.5%
Hallucination57.1%
SmolLM3-3B-GGUF3b1.9 GB
Rank #121/491
Accuracy76.7%
Latency6406 ms
DRS60.2%
Semantic59.7%
Factuality67.8%
Safety100.0%
Reliability84.4%
Hallucination56.1%
phi3:mini3.8b2.2 GB
Rank #122/491
Accuracy74.0%
Latency7478 ms
DRS60.2%
Semantic61.8%
Factuality69.2%
Safety95.4%
Reliability88.4%
Hallucination55.1%
granite-3.3-2b-instruct-GGUF:Q4_K_M2b1.5 GB
Rank #123/491
Accuracy79.8%
Latency6488 ms
DRS60.2%
Semantic63.7%
Factuality70.9%
Safety87.2%
Reliability86.0%
Hallucination54.8%
SmolLM2 1.7B Instruct1.7b1.1 GB
Rank #124/491
Accuracy72.6%
Latency4351 ms
DRS60.2%
Semantic65.3%
Factuality72.2%
Safety95.0%
Reliability33.3%
Hallucination27.8%
deepseek-coder:6.7b7b3.8 GB
Rank #125/491
Accuracy72.1%
Latency19073 ms
DRS60.2%
Semantic66.5%
Factuality73.2%
Safety96.3%
Reliability83.5%
Hallucination53.4%
Gemma 3 270M270m292 MB
Rank #126/491
Accuracy65.9%
Latency1144 ms
DRS60.2%
Semantic60.1%
Factuality67.5%
Safety96.4%
Reliability88.9%
Hallucination53.8%
hermes38b4.7 GB
Rank #127/491
Accuracy80.4%
Latency7694 ms
DRS60.2%
Semantic54.9%
Factuality63.5%
Safety98.7%
Reliability90.6%
Hallucination57.8%
glm4:9b9b5.5 GB
Rank #128/491
Accuracy77.2%
Latency16169 ms
DRS60.2%
Semantic59.1%
Factuality66.8%
Safety96.3%
Reliability90.8%
Hallucination56.5%
command-r7b:latest8b5.1 GB
Rank #129/491
Accuracy74.2%
Latency49433 ms
DRS60.1%
Semantic62.6%
Factuality70.1%
Safety100.0%
Reliability84.0%
Hallucination55.6%
yi-coder:9b8.8b5.0 GB
Rank #130/491
Accuracy73.2%
Latency10923 ms
DRS60.1%
Semantic65.6%
Factuality72.5%
Safety92.5%
Reliability86.3%
Hallucination53.7%
qwen2.5:0.5b-instruct-fp160.5b994 MB
Rank #131/491
Accuracy95.0%
Latency2508 ms
DRS60.1%
Semantic40.3%
Factuality52.2%
Safety100.0%
Reliability92.6%
Hallucination62.7%
dolphin38b4.9 GB
Rank #132/491
Accuracy69.4%
Latency4283 ms
DRS60.1%
Semantic61.2%
Factuality68.6%
Safety98.5%
Reliability90.1%
Hallucination55.1%
deepseek-coder-v2:16b16b8.9 GB
Rank #133/491
Accuracy68.3%
Latency14217 ms
DRS60.1%
Semantic65.7%
Factuality72.6%
Safety92.5%
Reliability91.2%
Hallucination53.5%
internlm21.8b1.1 GB
Rank #134/491
Accuracy57.9%
Latency1336 ms
DRS59.9%
Semantic66.5%
Factuality73.2%
Safety100.0%
Reliability88.6%
Hallucination53.4%
MiniCPM5-2B-GGUF:latest2b1.6GB
Rank #135/491
Accuracy76.1%
Latency6045 ms
DRS59.9%
Semantic64.0%
Factuality71.2%
Safety100.0%
Reliability75.7%
Hallucination55.3%
yi-coder:1.5b1.48b866 MB
Rank #136/491
Accuracy77.3%
Latency60424 ms
DRS59.9%
Semantic61.9%
Factuality69.5%
Safety100.0%
Reliability83.6%
Hallucination55.2%
wizard-math:7b7b4.1 GB
Rank #137/491
Accuracy98.3%
Latency10210 ms
DRS59.9%
Semantic40.4%
Factuality52.4%
Safety100.0%
Reliability90.3%
Hallucination62.5%
nemotron-3-nano:4b4.0b2.8 GB
Rank #138/491
Accuracy70.0%
Latency29585 ms
DRS59.9%
Semantic65.7%
Factuality72.5%
Safety100.0%
Reliability82.6%
Hallucination53.7%
qwen2.5-coder:3b-instruct-q6_K3b2.5 GB
Rank #139/491
Accuracy70.5%
Latency4725 ms
DRS59.9%
Semantic65.5%
Factuality72.4%
Safety96.3%
Reliability83.2%
Hallucination53.9%
EXAONE Deep2.4b4.2 GB
Rank #140/491
Accuracy92.9%
Latency6743 ms
DRS59.8%
Semantic44.3%
Factuality55.4%
Safety100.0%
Reliability89.3%
Hallucination62.7%
gemma:7b9b5.0 GB
Rank #141/491
Accuracy72.4%
Latency12719 ms
DRS59.8%
Semantic60.0%
Factuality68.0%
Safety97.0%
Reliability91.3%
Hallucination56.0%
wizardlm22b4.7 GB
Rank #142/491
Accuracy85.2%
Latency25546 ms
DRS59.7%
Semantic48.4%
Factuality58.7%
Safety100.0%
Reliability93.0%
Hallucination60.5%
granite3.1-moe1b1.4 GB
Rank #143/491
Accuracy72.6%
Latency3713 ms
DRS59.7%
Semantic65.6%
Factuality72.5%
Safety87.3%
Reliability86.6%
Hallucination53.7%
qwen2-math:1.5b-instruct-q5_11.5b397 MB
Rank #144/491
Accuracy76.3%
Latency4340 ms
DRS59.7%
Semantic58.8%
Factuality67.1%
Safety100.0%
Reliability82.3%
Hallucination56.7%
stablelm2:1.6b1.6b1 GB
Rank #145/491
Accuracy78.3%
Latency2964 ms
DRS59.7%
Semantic58.9%
Factuality67.1%
Safety94.0%
Reliability33.3%
Hallucination32.9%
codestral:22b22b12.6 GB
Rank #146/491
Accuracy76.5%
Latency68448 ms
DRS59.7%
Semantic61.1%
Factuality68.9%
Safety92.5%
Reliability88.9%
Hallucination55.3%
nemotron-mini:4b4b2.7 GB
Rank #147/491
Accuracy60.3%
Latency6982 ms
DRS59.7%
Semantic67.1%
Factuality73.7%
Safety100.0%
Reliability89.2%
Hallucination53.2%
falcon-h10.5b448b
Rank #148/491
Accuracy77.5%
Latency17576 ms
DRS59.6%
Semantic57.2%
Factuality65.2%
Safety95.0%
Reliability87.6%
Hallucination57.1%
Llama 3.2 1B Instruct (Q4_K_M)1b807mb
Rank #149/491
Accuracy65.1%
Latency766 ms
DRS59.6%
Semantic62.3%
Factuality69.9%
Safety100.0%
Reliability82.4%
Hallucination54.9%
tulu3:8b8b4.9 GB
Rank #150/491
Accuracy78.7%
Latency8702 ms
DRS59.6%
Semantic57.1%
Factuality65.7%
Safety97.1%
Reliability86.1%
Hallucination57.3%
gemma30.27b291 MB
Rank #151/491
Accuracy52.3%
Latency1109 ms
DRS59.5%
Semantic66.6%
Factuality73.3%
Safety100.0%
Reliability88.9%
Hallucination52.4%
sam860/olmo2:1b1b1.6 GB
Rank #152/491
Accuracy76.0%
Latency1342 ms
DRS59.5%
Semantic60.9%
Factuality68.8%
Safety85.0%
Reliability87.8%
Hallucination55.9%
Qwen2.5-0.5B-Instruct0.49b491 MB
Rank #153/491
Accuracy93.3%
Latency1358 ms
DRS59.5%
Semantic38.1%
Factuality50.4%
Safety100.0%
Reliability33.3%
Hallucination49.6%
qwen2.5-coder:3b3.09b1.9 GB
Rank #154/491
Accuracy63.7%
Latency8753 ms
DRS59.5%
Semantic67.5%
Factuality74.0%
Safety96.3%
Reliability86.8%
Hallucination53.2%
falcon2:11b11b6.4 GB
Rank #155/491
Accuracy31.9%
Latency10414 ms
DRS59.5%
Semantic56.7%
Factuality63.4%
Safety100.0%
Reliability100.0%
Hallucination40.4%
orca-mini:7b7b3.8 GB
Rank #156/491
Accuracy69.0%
Latency5364 ms
DRS59.5%
Semantic59.8%
Factuality67.8%
Safety100.0%
Reliability89.7%
Hallucination56.0%
qwen2.5:3b-instruct-fp163b6.2 GB
Rank #157/491
Accuracy68.2%
Latency21559 ms
DRS59.5%
Semantic64.1%
Factuality71.3%
Safety96.3%
Reliability88.7%
Hallucination54.6%
llama2.01.0b1.3 GB
Rank #158/491
Accuracy80.5%
Latency17867 ms
DRS59.4%
Semantic65.4%
Factuality72.3%
Safety74.0%
Reliability90.7%
Hallucination54.1%
aya-expanse8b5.0 GB
Rank #159/491
Accuracy82.9%
Latency4022 ms
DRS59.4%
Semantic47.8%
Factuality58.2%
Safety100.0%
Reliability92.0%
Hallucination59.9%
lfm3-audio:2b2b1.7 GB
Rank #160/491
Accuracy50.7%
Latency11151 ms
DRS59.4%
Semantic52.6%
Factuality58.8%
Safety100.0%
Reliability83.3%
Hallucination41.6%
falcon3:7b7b4.6 GB
Rank #161/491
Accuracy74.3%
Latency11066 ms
DRS59.4%
Semantic59.8%
Factuality67.8%
Safety96.5%
Reliability86.4%
Hallucination56.3%
deepcoder:1.5b1.5b1.1 GB
Rank #162/491
Accuracy80.9%
Latency19354 ms
DRS59.4%
Semantic62.2%
Factuality69.7%
Safety92.5%
Reliability78.0%
Hallucination55.1%
starling-lm7b4.1 GB
Rank #163/491
Accuracy76.8%
Latency10816 ms
DRS59.3%
Semantic55.5%
Factuality64.1%
Safety97.9%
Reliability89.4%
Hallucination57.6%
tinyllama1.1b637 MB
Rank #164/491
Accuracy68.0%
Latency1243 ms
DRS59.2%
Semantic63.0%
Factuality70.4%
Safety100.0%
Reliability77.1%
Hallucination54.8%
xwinlm7b3.8 GB
Rank #165/491
Accuracy77.5%
Latency4551 ms
DRS59.2%
Semantic58.5%
Factuality66.8%
Safety90.2%
Reliability87.7%
Hallucination56.5%
qwen2.5:3b3b1.9GB
Rank #166/491
Accuracy77.7%
Latency5029 ms
DRS59.2%
Semantic55.1%
Factuality64.1%
Safety95.0%
Reliability88.6%
Hallucination57.7%
qwen:4b4b2.3 GB
Rank #167/491
Accuracy59.5%
Latency7342 ms
DRS59.2%
Semantic69.4%
Factuality75.5%
Safety90.2%
Reliability92.9%
Hallucination52.4%
Qwen21.5b934 MB
Rank #168/491
Accuracy76.8%
Latency795 ms
DRS59.1%
Semantic54.2%
Factuality63.4%
Safety90.5%
Reliability85.2%
Hallucination57.0%
olmo2:7b7.3b4.5 GB
Rank #169/491
Accuracy83.3%
Latency4021 ms
DRS59.1%
Semantic44.7%
Factuality53.8%
Safety100.0%
Reliability87.7%
Hallucination57.7%
qwen3:8b8.19b5.2 GB
Rank #170/491
Accuracy68.0%
Latency62971 ms
DRS59.1%
Semantic65.4%
Factuality72.3%
Safety90.0%
Reliability90.7%
Hallucination53.8%
granite3.1-moe:3b3.3b2.0 GB
Rank #171/491
Accuracy57.9%
Latency6409 ms
DRS59.1%
Semantic66.1%
Factuality72.9%
Safety100.0%
Reliability90.1%
Hallucination53.5%
neural-chat:7b7b4.1 GB
Rank #172/491
Accuracy71.1%
Latency4972 ms
DRS59.1%
Semantic57.4%
Factuality65.6%
Safety98.2%
Reliability90.3%
Hallucination56.9%
nous-hermes:7b7b3.8 GB
Rank #173/491
Accuracy57.9%
Latency6662 ms
DRS59.1%
Semantic65.0%
Factuality72.0%
Safety100.0%
Reliability92.2%
Hallucination53.9%
Granite 4.0 H-1B1b901 MB
Rank #174/491
Accuracy72.6%
Latency6533 ms
DRS59.0%
Semantic63.8%
Factuality71.0%
Safety91.0%
Reliability83.8%
Hallucination54.9%
Ask-0.5B-GGUF0.5b631MB
Rank #175/491
Accuracy60.2%
Latency890 ms
DRS59.0%
Semantic65.2%
Factuality72.2%
Safety100.0%
Reliability33.3%
Hallucination27.8%
tinydolphin:1.1b1.1b636 MB
Rank #176/491
Accuracy58.4%
Latency1687 ms
DRS59.0%
Semantic69.2%
Factuality75.4%
Safety93.7%
Reliability33.3%
Hallucination24.6%
Qwen2.5 1.5B Instruct5b637 MB
Rank #177/491
Accuracy73.4%
Latency3579 ms
DRS59.0%
Semantic61.8%
Factuality69.5%
Safety96.2%
Reliability33.3%
Hallucination30.5%
LFM2-350M350m229 MB
Rank #178/491
Accuracy64.1%
Latency1970 ms
DRS59.0%
Semantic66.2%
Factuality73.0%
Safety87.3%
Reliability33.3%
Hallucination27.0%
exaone3.52.4b1.6 GB
Rank #179/491
Accuracy76.7%
Latency4432 ms
DRS59.0%
Semantic55.0%
Factuality64.0%
Safety95.9%
Reliability88.4%
Hallucination57.9%
yi-coder1.5b866 MB
Rank #180/491
Accuracy69.8%
Latency2167 ms
DRS58.9%
Semantic61.5%
Factuality69.3%
Safety96.3%
Reliability81.7%
Hallucination55.3%
Llama 3.2 1B1b1.3 GB
Rank #181/491
Accuracy68.4%
Latency3592 ms
DRS58.9%
Semantic61.9%
Factuality69.5%
Safety100.0%
Reliability81.3%
Hallucination55.3%
Llama 3.2 1B Instruct1b807 MB
Rank #182/491
Accuracy69.0%
Latency3741 ms
DRS58.9%
Semantic62.0%
Factuality69.6%
Safety94.0%
Reliability33.3%
Hallucination30.4%
StableLM 2 Zephyr1.6 billion983MB
Rank #183/491
Accuracy64.0%
Latency1858 ms
DRS58.9%
Semantic63.4%
Factuality70.8%
Safety100.0%
Reliability33.3%
Hallucination29.2%
qwen3:4b4b2.5 GB
Rank #184/491
Accuracy81.7%
Latency40736 ms
DRS58.9%
Semantic57.7%
Factuality66.2%
Safety86.4%
Reliability88.8%
Hallucination57.8%
internlm2:1.8b1.8b1.1 GB
Rank #185/491
Accuracy61.2%
Latency441 ms
DRS58.8%
Semantic58.1%
Factuality64.9%
Safety95.7%
Reliability90.8%
Hallucination55.7%
gemma22.0b1.6 GB
Rank #186/491
Accuracy78.6%
Latency6095 ms
DRS58.7%
Semantic51.0%
Factuality60.9%
Safety100.0%
Reliability88.5%
Hallucination59.7%
ternary-bonsai1.7b3.4 GB
Rank #187/491
Accuracy91.4%
Latency13473 ms
DRS58.7%
Semantic53.7%
Factuality62.9%
Safety81.0%
Reliability86.2%
Hallucination58.3%
phi3:latest3.8b2.2GB
Rank #188/491
Accuracy78.9%
Latency44801 ms
DRS58.7%
Semantic56.8%
Factuality64.8%
Safety97.5%
Reliability81.3%
Hallucination57.3%
exaone3.5:7.8b7.8b4.8 GB
Rank #189/491
Accuracy86.6%
Latency8323 ms
DRS58.7%
Semantic44.9%
Factuality55.9%
Safety100.0%
Reliability89.4%
Hallucination61.3%
cogito:8b8.0b4.9 GB
Rank #190/491
Accuracy69.6%
Latency6830 ms
DRS58.7%
Semantic56.2%
Factuality65.0%
Safety100.0%
Reliability90.6%
Hallucination57.7%
vertalily1.21.0b600 MB
Rank #191/491
Accuracy67.4%
Latency1880 ms
DRS58.6%
Semantic67.1%
Factuality73.7%
Safety82.0%
Reliability86.4%
Hallucination53.6%
D1-3B3b1.7GB
Rank #192/491
Accuracy74.5%
Latency4138 ms
DRS58.6%
Semantic60.3%
Factuality68.2%
Safety88.0%
Reliability33.3%
Hallucination31.8%
smollm1.7b990 MB
Rank #193/491
Accuracy83.9%
Latency4644 ms
DRS58.5%
Semantic44.8%
Factuality55.8%
Safety100.0%
Reliability90.6%
Hallucination61.4%
tulu38b4.9 GB
Rank #194/491
Accuracy72.5%
Latency16815 ms
DRS58.5%
Semantic60.5%
Factuality68.4%
Safety94.0%
Reliability84.8%
Hallucination57.0%
Bielik-1.5B-v3.0-Instruct-GGUF:Q8_01.5b1.7 GB
Rank #195/491
Accuracy62.8%
Latency5018 ms
DRS58.5%
Semantic66.2%
Factuality72.9%
Safety100.0%
Reliability33.3%
Hallucination27.1%
OLMo-1B-Instruct1b935 MB
Rank #196/491
Accuracy70.1%
Latency3904 ms
DRS58.5%
Semantic60.2%
Factuality68.2%
Safety100.0%
Reliability33.3%
Hallucination31.8%
StableLM2:1.6B1.6b103mb
Rank #197/491
Accuracy66.3%
Latency12375 ms
DRS58.5%
Semantic64.2%
Factuality71.4%
Safety95.0%
Reliability84.6%
Hallucination71.4%
gemma3:12b12b8.2 GB
Rank #198/491
Accuracy82.4%
Latency124448 ms
DRS58.5%
Semantic60.1%
Factuality68.1%
Safety78.7%
Reliability88.4%
Hallucination55.6%
bonsai1.7b248 MB
Rank #199/491
Accuracy76.7%
Latency3672 ms
DRS58.4%
Semantic61.0%
Factuality68.8%
Safety79.0%
Reliability89.4%
Hallucination55.5%
qwen2.5:1.5b-instruct-fp161.5b3.1 GB
Rank #200/491
Accuracy85.0%
Latency3031 ms
DRS58.4%
Semantic43.4%
Factuality52.7%
Safety100.0%
Reliability91.7%
Hallucination61.6%
deepscaler:1.5b1.5b3.6 GB
Rank #201/491
Accuracy100.0%
Latency31452 ms
DRS58.4%
Semantic34.2%
Factuality47.4%
Safety100.0%
Reliability91.3%
Hallucination64.8%
qwen30.6b522 MB
Rank #202/491
Accuracy74.2%
Latency5306 ms
DRS58.3%
Semantic55.5%
Factuality64.2%
Safety95.7%
Reliability87.5%
Hallucination57.4%
gemma3-it1.0b689 MB
Rank #203/491
Accuracy65.4%
Latency8975 ms
DRS58.3%
Semantic65.1%
Factuality72.1%
Safety88.7%
Reliability88.6%
Hallucination53.9%
qwen2.5:1.5b-instruct-q5_15b1.2 GB
Rank #204/491
Accuracy73.2%
Latency4366 ms
DRS58.3%
Semantic65.7%
Factuality72.6%
Safety78.0%
Reliability86.3%
Hallucination53.8%
granite3.1-moe1.0b1.4 GB
Rank #205/491
Accuracy78.9%
Latency5409 ms
DRS58.2%
Semantic63.0%
Factuality70.4%
Safety73.5%
Reliability88.3%
Hallucination55.0%
qwen2-math:1.5b1.5b935MB
Rank #206/491
Accuracy95.0%
Latency15537 ms
DRS58.2%
Semantic36.2%
Factuality48.9%
Safety100.0%
Reliability92.4%
Hallucination68.2%
yi:6b6b3.5 GB
Rank #207/491
Accuracy73.3%
Latency9122 ms
DRS58.2%
Semantic56.7%
Factuality65.1%
Safety94.5%
Reliability87.3%
Hallucination57.0%
deepseek-r1:8b8.2b5.2 GB
Rank #208/491
Accuracy80.2%
Latency53742 ms
DRS58.2%
Semantic50.7%
Factuality60.5%
Safety97.0%
Reliability88.8%
Hallucination60.4%
qwen2.50.5b397 MB
Rank #209/491
Accuracy71.9%
Latency2590 ms
DRS58.1%
Semantic57.6%
Factuality66.0%
Safety95.9%
Reliability83.5%
Hallucination56.9%
medpsy1.7b4.1 GB
Rank #210/491
Accuracy90.2%
Latency28452 ms
DRS58.0%
Semantic49.3%
Factuality59.4%
Safety81.0%
Reliability92.5%
Hallucination60.9%
Qwen 2.5 Coder3b1.9GB
Rank #211/491
Accuracy59.0%
Latency2672 ms
DRS58.0%
Semantic63.5%
Factuality70.8%
Safety100.0%
Reliability83.7%
Hallucination54.6%
dolphin-llama38b4.7 GB
Rank #212/491
Accuracy58.7%
Latency1960 ms
DRS58.0%
Semantic60.9%
Factuality67.9%
Safety99.2%
Reliability86.5%
Hallucination54.7%
atem-wisdom1.5b986 MB
Rank #213/491
Accuracy69.6%
Latency7373 ms
DRS57.9%
Semantic62.1%
Factuality69.7%
Safety96.3%
Reliability78.7%
Hallucination55.7%
MeetSolanki/MeetAISmall0.3b241 MB
Rank #214/491
Accuracy73.0%
Latency2194 ms
DRS57.9%
Semantic56.8%
Factuality65.4%
Safety90.5%
Reliability85.8%
Hallucination57.9%
llama3.2:1b1b1.3 GB
Rank #215/491
Accuracy70.5%
Latency3741 ms
DRS57.9%
Semantic53.3%
Factuality62.7%
Safety100.0%
Reliability60.1%
Hallucination50.1%
Granite3.1-dense:1b1b
Rank #216/491
Accuracy75.0%
Latency46500 ms
DRS57.9%
Semantic59.5%
Factuality67.6%
Safety96.2%
Reliability78.2%
Hallucination56.7%
gemma3:1b1b883 MB
Rank #217/491
Accuracy66.1%
Latency27340 ms
DRS57.8%
Semantic63.1%
Factuality70.5%
Safety97.0%
Reliability81.6%
Hallucination55.5%
llama3.2:1b-instruct-q5_K_M1.24b800MB
Rank #218/491
Accuracy66.1%
Latency27340 ms
DRS57.8%
Semantic63.1%
Factuality70.5%
Safety97.0%
Reliability81.6%
Hallucination55.5%
EuroLLM 1.7B Instruct (Q4_K_M)1.7b1.0 GB
Rank #219/491
Accuracy67.3%
Latency2601 ms
DRS57.8%
Semantic59.5%
Factuality67.6%
Safety94.0%
Reliability33.3%
Hallucination32.4%
deepscaler1.5b3.6 GB
Rank #220/491
Accuracy100.0%
Latency19449 ms
DRS57.7%
Semantic33.1%
Factuality46.4%
Safety100.0%
Reliability88.3%
Hallucination65.1%
falcon31.0b1.8 GB
Rank #221/491
Accuracy73.2%
Latency4049 ms
DRS57.7%
Semantic57.9%
Factuality65.1%
Safety96.3%
Reliability79.7%
Hallucination56.7%
lfm20.35b229 MB
Rank #222/491
Accuracy79.7%
Latency1370 ms
DRS57.7%
Semantic44.9%
Factuality55.9%
Safety98.5%
Reliability87.2%
Hallucination61.3%
exaone-4.01.2b812 MB
Rank #223/491
Accuracy90.2%
Latency48734 ms
DRS57.7%
Semantic41.2%
Factuality53.0%
Safety100.0%
Reliability86.8%
Hallucination63.0%
Llama SmolTalk 3.2 1B Instruct Q4_K_M1b672 MB
Rank #224/491
Accuracy81.6%
Latency1280 ms
DRS57.7%
Semantic44.6%
Factuality55.7%
Safety100.0%
Reliability83.8%
Hallucination61.4%
Dolphin 3.0 Llama 3.2 1B1b1.3 GB
Rank #225/491
Accuracy66.4%
Latency3442 ms
DRS57.7%
Semantic60.0%
Factuality68.0%
Safety94.0%
Reliability85.3%
Hallucination55.8%
orca-mini:3b3.43b2.0 GB
Rank #226/491
Accuracy60.0%
Latency6850 ms
DRS57.7%
Semantic64.8%
Factuality71.8%
Safety90.0%
Reliability90.5%
Hallucination54.0%
medgemma:4b4.3b3.3 GB
Rank #227/491
Accuracy75.9%
Latency13315 ms
DRS57.7%
Semantic48.4%
Factuality58.7%
Safety100.0%
Reliability90.9%
Hallucination60.3%
ministral-3:3b-instruct-2512-q8_03b4.5 GB
Rank #228/491
Accuracy68.1%
Latency21322 ms
DRS57.7%
Semantic64.6%
Factuality71.7%
Safety82.3%
Reliability89.6%
Hallucination54.0%
Phi-4-mini-instruct3.8b2.49 GB
Rank #229/491
Accuracy78.0%
Latency2223 ms
DRS57.6%
Semantic51.7%
Factuality61.3%
Safety90.5%
Reliability86.3%
Hallucination59.0%
Medllama-1B-Instruct-v3-GGUF:Q4_K_M1 b807 MB
Rank #230/491
Accuracy75.4%
Latency1069 ms
DRS57.6%
Semantic45.2%
Factuality56.2%
Safety100.0%
Reliability88.8%
Hallucination61.2%
MiniCPM5-1B1.08b688 MB
Rank #231/491
Accuracy72.4%
Latency73454 ms
DRS57.6%
Semantic60.8%
Factuality68.6%
Safety88.7%
Reliability33.3%
Hallucination31.4%
h2oai500m350 MB
Rank #232/491
Accuracy60.4%
Latency1161 ms
DRS57.5%
Semantic59.8%
Factuality67.9%
Safety100.0%
Reliability81.1%
Hallucination0.0%
smollm2:360m360 million725 MB
Rank #233/491
Accuracy89.7%
Latency1101 ms
DRS57.5%
Semantic42.1%
Factuality51.7%
Safety100.0%
Reliability33.3%
Hallucination48.3%
qwen2.5-coder:3b3b1.9 GB
Rank #234/491
Accuracy66.8%
Latency2611 ms
DRS57.5%
Semantic56.4%
Factuality64.8%
Safety98.5%
Reliability84.0%
Hallucination57.1%
Qwen2:1.5b1.5b935 MB
Rank #235/491
Accuracy66.4%
Latency1907 ms
DRS57.5%
Semantic56.7%
Factuality64.2%
Safety98.1%
Reliability84.3%
Hallucination57.2%
TinyLlama-1.1B-Chat-v1.01b407MB
Rank #236/491
Accuracy60.9%
Latency1521 ms
DRS57.4%
Semantic62.9%
Factuality70.3%
Safety100.0%
Reliability33.3%
Hallucination29.7%
lfm2.5:8b8.5b5.2 GB
Rank #237/491
Accuracy85.2%
Latency22189 ms
DRS57.4%
Semantic44.1%
Factuality55.3%
Safety97.0%
Reliability88.9%
Hallucination62.9%
llama3:8b8b4.7 GB
Rank #238/491
Accuracy64.2%
Latency21058 ms
DRS57.4%
Semantic63.5%
Factuality70.8%
Safety87.3%
Reliability89.9%
Hallucination54.4%
smollm21.7b1.8 GB
Rank #239/491
Accuracy66.0%
Latency2845 ms
DRS57.3%
Semantic65.6%
Factuality72.5%
Safety78.0%
Reliability87.8%
Hallucination54.1%
stablelm-zephyr3.0b1.6 GB
Rank #240/491
Accuracy66.7%
Latency2475 ms
DRS57.3%
Semantic58.0%
Factuality66.3%
Safety98.1%
Reliability80.4%
Hallucination56.5%
Nemotron Mini 4B Instruct Q4_K_M4b2.7GB
Rank #241/491
Accuracy59.5%
Latency679 ms
DRS57.3%
Semantic53.6%
Factuality62.9%
Safety100.0%
Reliability90.2%
Hallucination57.9%
WizardLM-2 7B2.7b4.1B
Rank #242/491
Accuracy73.8%
Latency3879 ms
DRS57.3%
Semantic60.3%
Factuality68.3%
Safety80.4%
Reliability85.9%
Hallucination55.7%
Borealis 1B Instruct1b806 MB
Rank #243/491
Accuracy59.1%
Latency2185 ms
DRS57.2%
Semantic63.0%
Factuality70.4%
Safety100.0%
Reliability33.3%
Hallucination29.6%
gemma3:4b4b3.4gb
Rank #244/491
Accuracy76.9%
Latency20524 ms
DRS57.2%
Semantic53.0%
Factuality61.9%
Safety89.1%
Reliability89.8%
Hallucination58.8%
llama3.2:3b3.21b2.0 GB
Rank #245/491
Accuracy66.0%
Latency7093 ms
DRS57.1%
Semantic54.6%
Factuality61.7%
Safety97.0%
Reliability92.9%
Hallucination58.6%
deepseek-r1:8b8.19b5.2 GB
Rank #246/491
Accuracy96.4%
Latency277705 ms
DRS57.1%
Semantic48.7%
Factuality58.9%
Safety81.0%
Reliability68.2%
Hallucination56.2%
phi3:3.8b-mini-128k-instruct-q4_K_M3.8b2.4 GB
Rank #247/491
Accuracy67.7%
Latency8205 ms
DRS57.1%
Semantic54.1%
Factuality61.3%
Safety100.0%
Reliability89.1%
Hallucination59.1%
dolphin-phi2.7b1.6GB
Rank #248/491
Accuracy83.0%
Latency954 ms
DRS57.0%
Semantic45.4%
Factuality56.3%
Safety90.5%
Reliability83.8%
Hallucination61.2%
granite40.35b708 MB
Rank #249/491
Accuracy67.5%
Latency1956 ms
DRS56.9%
Semantic56.5%
Factuality64.6%
Safety97.3%
Reliability81.4%
Hallucination57.0%
smollm:1.7b1.7b1GB
Rank #250/491
Accuracy60.4%
Latency1562 ms
DRS56.9%
Semantic55.1%
Factuality64.1%
Safety100.0%
Reliability88.1%
Hallucination57.8%
falcon31b1.8 GB
Rank #251/491
Accuracy74.4%
Latency6606 ms
DRS56.8%
Semantic64.8%
Factuality71.9%
Safety74.0%
Reliability81.3%
Hallucination54.1%
H2O-Danube3-0.5B500m317 MB
Rank #252/491
Accuracy66.8%
Latency1467 ms
DRS56.8%
Semantic59.6%
Factuality67.7%
Safety85.0%
Reliability33.3%
Hallucination32.3%
ministral-33.0b3.0 GB
Rank #253/491
Accuracy67.4%
Latency9955 ms
DRS56.7%
Semantic59.3%
Factuality67.5%
Safety86.4%
Reliability89.0%
Hallucination56.2%
llama3.2:3b-instruct-fp163b6.4 GB
Rank #254/491
Accuracy69.1%
Latency13342 ms
DRS56.7%
Semantic53.3%
Factuality60.6%
Safety97.0%
Reliability89.7%
Hallucination58.6%
hunyuan-instruct1.8b1.1 GB
Rank #255/491
Accuracy98.3%
Latency15320 ms
DRS56.6%
Semantic33.4%
Factuality46.7%
Safety100.0%
Reliability82.1%
Hallucination65.3%
mistral-nemo12b7.1 GB
Rank #256/491
Accuracy85.2%
Latency3382 ms
DRS56.6%
Semantic45.1%
Factuality56.1%
Safety83.0%
Reliability91.4%
Hallucination61.6%
TinyLlama 1.1B1.1 billion637 MB
Rank #257/491
Accuracy36.0%
Latency4524 ms
DRS56.6%
Semantic42.8%
Factuality57.7%
Safety150.0%
Reliability57.9%
Hallucination45.1%
qwen2.5:7b7.6b4.7 GB
Rank #258/491
Accuracy70.3%
Latency11470 ms
DRS56.6%
Semantic49.7%
Factuality59.7%
Safety100.0%
Reliability89.1%
Hallucination59.7%
qwen2.5-coder:1.5b1.5b986 MB
Rank #259/491
Accuracy63.6%
Latency3755 ms
DRS56.5%
Semantic55.2%
Factuality64.1%
Safety97.5%
Reliability83.7%
Hallucination57.5%
GRAFT-1B1b971 MB
Rank #260/491
Accuracy62.6%
Latency2088 ms
DRS56.4%
Semantic65.8%
Factuality72.7%
Safety74.0%
Reliability88.8%
Hallucination54.0%
DeepSeek-R1-Distill-Qwen-1.5B1.5b1.1 GB
Rank #261/491
Accuracy95.0%
Latency12150 ms
DRS56.3%
Semantic30.8%
Factuality44.6%
Safety100.0%
Reliability33.3%
Hallucination55.4%
Granite 4 3B-H3b1.9 GB
Rank #262/491
Accuracy60.3%
Latency20217 ms
DRS56.3%
Semantic59.3%
Factuality65.4%
Safety97.0%
Reliability88.3%
Hallucination56.8%
mistral-openorca:7b7b4.1 GB
Rank #263/491
Accuracy57.3%
Latency8926 ms
DRS56.3%
Semantic57.8%
Factuality64.3%
Safety100.0%
Reliability90.9%
Hallucination56.7%
llama-3.2-1b-instruct-fine-tuned1.24b808 MB
Rank #264/491
Accuracy65.4%
Latency2733 ms
DRS56.3%
Semantic53.6%
Factuality62.4%
Safety98.5%
Reliability84.4%
Hallucination58.4%
deepseek-coder1.3b776 MB
Rank #265/491
Accuracy57.2%
Latency2095 ms
DRS56.2%
Semantic63.3%
Factuality70.7%
Safety96.3%
Reliability77.3%
Hallucination54.5%
granite3.22.0b1.5 GB
Rank #266/491
Accuracy83.9%
Latency8569 ms
DRS56.2%
Semantic50.8%
Factuality60.7%
Safety81.0%
Reliability84.3%
Hallucination59.6%
gemma3270m291MB
Rank #267/491
Accuracy61.0%
Latency7262 ms
DRS56.2%
Semantic56.1%
Factuality64.6%
Safety96.3%
Reliability87.5%
Hallucination56.6%
qwen2.5:0.5b-instruct0.5b486 MB
Rank #268/491
Accuracy66.1%
Latency4615 ms
DRS56.2%
Semantic53.1%
Factuality62.5%
Safety97.4%
Reliability82.4%
Hallucination58.4%
MeetSolanki/MeetAISmall0.7b523 MB
Rank #269/491
Accuracy56.8%
Latency1839 ms
DRS56.2%
Semantic55.0%
Factuality64.0%
Safety100.0%
Reliability89.2%
Hallucination57.8%
Gemma 2 2B2.2b1.6 GB
Rank #270/491
Accuracy70.5%
Latency7963 ms
DRS56.2%
Semantic48.3%
Factuality58.6%
Safety100.0%
Reliability33.3%
Hallucination41.4%
stablelm2:11.6 billion1.8 GB
Rank #271/491
Accuracy70.9%
Latency15400 ms
DRS56.1%
Semantic50.0%
Factuality60.0%
Safety100.0%
Reliability85.0%
Hallucination59.5%
qwen:0.5b0.5b500M
Rank #272/491
Accuracy45.1%
Latency3422 ms
DRS56.1%
Semantic67.1%
Factuality73.7%
Safety100.0%
Reliability83.5%
Hallucination53.2%
stable-beluga:latest1b3.8 GB
Rank #273/491
Accuracy55.5%
Latency1138 ms
DRS55.9%
Semantic53.0%
Factuality62.4%
Safety100.0%
Reliability90.1%
Hallucination58.1%
Borealis-270M-Instruct-Preview270m303 MB
Rank #274/491
Accuracy53.9%
Latency1824 ms
DRS55.9%
Semantic61.3%
Factuality69.1%
Safety100.0%
Reliability33.3%
Hallucination30.9%
gemma3:4b-it-qat4b4.0 GB
Rank #275/491
Accuracy72.5%
Latency22196 ms
DRS55.9%
Semantic47.5%
Factuality57.1%
Safety98.5%
Reliability88.7%
Hallucination60.7%
mistral:7b7.2b4.4 GB
Rank #276/491
Accuracy60.1%
Latency8602 ms
DRS55.8%
Semantic54.6%
Factuality63.7%
Safety100.0%
Reliability87.8%
Hallucination58.7%
phi4-mini-reasoning:3.8b3.8b3.2 GB
Rank #277/491
Accuracy81.8%
Latency35185 ms
DRS55.8%
Semantic47.0%
Factuality57.6%
Safety87.2%
Reliability87.1%
Hallucination61.6%
yi:9b9b5.0 GB
Rank #278/491
Accuracy66.5%
Latency13933 ms
DRS55.8%
Semantic50.5%
Factuality60.4%
Safety97.0%
Reliability90.4%
Hallucination59.7%
Llama-3.2-1B-no-robots1.24b808 MB
Rank #279/491
Accuracy67.1%
Latency1106 ms
DRS55.8%
Semantic53.0%
Factuality62.0%
Safety94.1%
Reliability79.6%
Hallucination58.5%
phi3:3.8b-mini-4k-instruct-q8_03.8b4.1 GB
Rank #280/491
Accuracy60.1%
Latency5376 ms
DRS55.8%
Semantic53.9%
Factuality61.1%
Safety100.0%
Reliability89.8%
Hallucination58.5%
orca-mini3b2.0 GB
Rank #281/491
Accuracy55.9%
Latency1648 ms
DRS55.7%
Semantic54.0%
Factuality61.4%
Safety99.6%
Reliability89.2%
Hallucination57.7%
hermes33.0b2.0 GB
Rank #282/491
Accuracy56.7%
Latency4374 ms
DRS55.6%
Semantic60.9%
Factuality68.7%
Safety91.0%
Reliability86.5%
Hallucination55.7%
granite4.2:3b3.7b2.2 GB
Rank #283/491
Accuracy79.0%
Latency24423 ms
DRS55.6%
Semantic45.0%
Factuality56.0%
Safety90.2%
Reliability90.2%
Hallucination62.6%
lfm2-1.2b1.2b730mb
Rank #284/491
Accuracy74.5%
Latency15360 ms
DRS55.5%
Semantic47.4%
Factuality57.9%
Safety90.0%
Reliability90.4%
Hallucination60.5%
granite43b2.1 GB
Rank #285/491
Accuracy59.2%
Latency1254 ms
DRS55.5%
Semantic51.7%
Factuality61.4%
Safety100.0%
Reliability83.7%
Hallucination58.2%
granite3.3:8b8.2b4.9 GB
Rank #286/491
Accuracy58.4%
Latency10937 ms
DRS55.5%
Semantic54.6%
Factuality61.7%
Safety100.0%
Reliability90.5%
Hallucination58.5%
qwen3.5:9b9.0b6.6 GB
Rank #287/491
Accuracy67.4%
Latency60490 ms
DRS55.5%
Semantic52.2%
Factuality59.8%
Safety97.0%
Reliability87.2%
Hallucination59.1%
granite3-dense:8b8.2b4.9 GB
Rank #288/491
Accuracy47.5%
Latency20234 ms
DRS55.5%
Semantic61.8%
Factuality69.4%
Safety100.0%
Reliability89.7%
Hallucination55.0%
minicpm-v4.6:1b752.16m1.6 GB
Rank #289/491
Accuracy70.0%
Latency10317 ms
DRS55.4%
Semantic44.2%
Factuality55.4%
Safety100.0%
Reliability91.3%
Hallucination62.4%
treyleo161 billion1gb
Rank #290/491
Accuracy41.2%
Latency287 ms
DRS55.4%
Semantic64.6%
Factuality71.7%
Safety100.0%
Reliability77.9%
Hallucination54.3%
SmolLM2-360M-Instruct360 m270 MB
Rank #291/491
Accuracy62.9%
Latency395 ms
DRS55.3%
Semantic54.1%
Factuality63.3%
Safety100.0%
Reliability33.3%
Hallucination36.7%
Stable Code Instruct 3B Q4_K_M3b1.7GB
Rank #292/491
Accuracy60.9%
Latency430 ms
DRS55.2%
Semantic49.8%
Factuality59.8%
Safety100.0%
Reliability79.5%
Hallucination59.6%
smollm:1.7b-instruct-v0.2-q4_K_M1.7b1.1 GB
Rank #293/491
Accuracy71.8%
Latency1771 ms
DRS55.2%
Semantic43.9%
Factuality55.1%
Safety90.5%
Reliability92.1%
Hallucination61.7%
qwen2.5-coder3b1.9 GB
Rank #294/491
Accuracy52.3%
Latency4390 ms
DRS55.2%
Semantic57.9%
Factuality66.3%
Safety100.0%
Reliability85.8%
Hallucination56.6%
medllama2:7b7b3.8 GB
Rank #295/491
Accuracy66.8%
Latency10526 ms
DRS55.2%
Semantic51.2%
Factuality61.0%
Safety100.0%
Reliability81.5%
Hallucination59.1%
qwen2.5-coder-instruct3.0b2.1 GB
Rank #296/491
Accuracy48.2%
Latency3428 ms
DRS55.1%
Semantic66.1%
Factuality72.8%
Safety96.3%
Reliability77.1%
Hallucination53.0%
lfm3:1.7b1.7b103mb
Rank #297/491
Accuracy63.6%
Latency29 ms
DRS55.1%
Semantic54.3%
Factuality63.5%
Safety94.0%
Reliability86.2%
Hallucination59.6%
gemma3:4b-it-q8_04b5.0 GB
Rank #298/491
Accuracy73.4%
Latency27840 ms
DRS55.1%
Semantic45.6%
Factuality56.5%
Safety97.0%
Reliability86.7%
Hallucination62.1%
qwen2.5-coder:7b7.6b4.7 GB
Rank #299/491
Accuracy65.7%
Latency20152 ms
DRS55.0%
Semantic50.9%
Factuality58.7%
Safety100.0%
Reliability84.8%
Hallucination59.6%
qwen2:0.5b-instruct0.494b440 MB
Rank #300/491
Accuracy52.3%
Latency4230 ms
DRS54.9%
Semantic61.3%
Factuality69.1%
Safety100.0%
Reliability77.8%
Hallucination55.5%
Qwen2.5-0.5B-Instruct0.5b397 MB
Rank #301/491
Accuracy68.2%
Latency2019 ms
DRS54.9%
Semantic56.8%
Factuality65.4%
Safety80.4%
Reliability33.3%
Hallucination34.6%
phi3.5:3.8b3.8b2.2 GB
Rank #302/491
Accuracy75.4%
Latency20273 ms
DRS54.9%
Semantic51.0%
Factuality60.8%
Safety92.5%
Reliability76.4%
Hallucination58.8%
medgemma1.5:4b4.3b3.3 GB
Rank #303/491
Accuracy96.4%
Latency42574 ms
DRS54.8%
Semantic39.5%
Factuality51.6%
Safety76.2%
Reliability86.5%
Hallucination63.7%
granite4:3b3.4b2.1 GB
Rank #304/491
Accuracy49.8%
Latency2582 ms
DRS54.8%
Semantic57.2%
Factuality63.7%
Safety100.0%
Reliability88.7%
Hallucination57.9%
gemma2:2b-instruct-q8_02b2.8 GB
Rank #305/491
Accuracy65.6%
Latency8070 ms
DRS54.8%
Semantic49.0%
Factuality57.2%
Safety97.0%
Reliability88.8%
Hallucination60.4%
LFM2.5-1.2B Thinking2b731mb
Rank #306/491
Accuracy75.9%
Latency1 ms
DRS54.7%
Semantic63.7%
Factuality90.6%
Safety33.3%
Reliability100.0%
Hallucination100.0%
SmolLM2-360M-Instruct360m229MB
Rank #307/491
Accuracy59.4%
Latency1106 ms
DRS54.7%
Semantic61.2%
Factuality69.0%
Safety96.2%
Reliability33.3%
Hallucination31.0%
Borealis-1B-Instruct-Preview1 b806 MB
Rank #308/491
Accuracy80.4%
Latency3570 ms
DRS54.7%
Semantic46.8%
Factuality57.5%
Safety92.5%
Reliability33.3%
Hallucination42.5%
lfm3-vl:2b1.7b1.5 GB
Rank #309/491
Accuracy63.1%
Latency15500 ms
DRS54.7%
Semantic51.9%
Factuality61.5%
Safety100.0%
Reliability82.3%
Hallucination59.6%
yarn-mistral:7b7b4.1 GB
Rank #310/491
Accuracy70.4%
Latency29453 ms
DRS54.7%
Semantic59.5%
Factuality67.6%
Safety87.3%
Reliability71.1%
Hallucination55.8%
opencoder:1.5b-instruct-q4_K_M1.5b1.4 GB
Rank #311/491
Accuracy78.0%
Latency1516 ms
DRS54.6%
Semantic39.5%
Factuality46.6%
Safety100.0%
Reliability82.1%
Hallucination62.4%
GGUF Q4_K_M1.5b972 MB
Rank #312/491
Accuracy55.4%
Latency4305 ms
DRS54.5%
Semantic61.3%
Factuality69.0%
Safety94.0%
Reliability33.3%
Hallucination31.0%
hunyuan-0.5b-instruct0.5b320mb
Rank #313/491
Accuracy85.2%
Latency29509 ms
DRS54.3%
Semantic38.3%
Factuality50.6%
Safety100.0%
Reliability76.3%
Hallucination63.6%
dolphin3:8b8.0b4.9 GB
Rank #314/491
Accuracy48.0%
Latency3926 ms
DRS54.3%
Semantic58.5%
Factuality64.8%
Safety100.0%
Reliability86.7%
Hallucination56.8%
llama3:8b8.0b4.7 GB
Rank #315/491
Accuracy62.3%
Latency13816 ms
DRS54.3%
Semantic51.6%
Factuality59.3%
Safety100.0%
Reliability83.5%
Hallucination59.5%
deepseek-r11.5b1.1 GB
Rank #316/491
Accuracy62.4%
Latency10296 ms
DRS54.1%
Semantic53.4%
Factuality63.7%
Safety96.9%
Reliability78.6%
Hallucination58.1%
babar_jamali/gemma3-abliterated-1b806 MB
Rank #317/491
Accuracy51.3%
Latency22439 ms
DRS54.1%
Semantic60.1%
Factuality68.1%
Safety97.0%
Reliability81.6%
Hallucination56.2%
onellm-doey-v11.0b1.3 GB
Rank #318/491
Accuracy47.2%
Latency972 ms
DRS54.0%
Semantic67.9%
Factuality74.3%
Safety96.2%
Reliability63.4%
Hallucination53.0%
Ling-3.0-tiny-GGUF:Q4_K_M7.9b total (1.3b active)6.4GB
Rank #319/491
Accuracy69.1%
Latency3024 ms
DRS54.0%
Semantic48.7%
Factuality58.9%
Safety90.5%
Reliability81.5%
Hallucination60.4%
sailor21b1.1 GB
Rank #320/491
Accuracy66.2%
Latency5506 ms
DRS54.0%
Semantic49.8%
Factuality59.2%
Safety94.3%
Reliability80.9%
Hallucination59.6%
gemma4:e4b8b (4.5b effective)9.6 GB
Rank #321/491
Accuracy65.8%
Latency41750 ms
DRS54.0%
Semantic50.1%
Factuality58.1%
Safety94.0%
Reliability86.5%
Hallucination61.2%
qwen2:7b7.6b4.4 GB
Rank #322/491
Accuracy58.5%
Latency11793 ms
DRS54.0%
Semantic50.4%
Factuality58.3%
Safety100.0%
Reliability87.7%
Hallucination59.6%
granite4350m708 MB
Rank #323/491
Accuracy71.3%
Latency658 ms
DRS53.9%
Semantic52.4%
Factuality61.9%
Safety90.5%
Reliability63.6%
Hallucination58.3%
Yi-Coder 1.5B Chat1.5b866 MB
Rank #324/491
Accuracy52.5%
Latency1367 ms
DRS53.8%
Semantic59.4%
Factuality67.5%
Safety94.0%
Reliability33.3%
Hallucination32.5%
llama3.1:8b8.0b4.9 GB
Rank #325/491
Accuracy59.9%
Latency18677 ms
DRS53.8%
Semantic50.1%
Factuality58.1%
Safety96.2%
Reliability90.0%
Hallucination59.6%
falcon3:3b3.23b2.0 GB
Rank #326/491
Accuracy86.7%
Latency6623 ms
DRS53.8%
Semantic29.8%
Factuality41.8%
Safety100.0%
Reliability82.1%
Hallucination64.6%
jewelzufo/VertaLily-1.21b724 MB
Rank #327/491
Accuracy53.8%
Latency4713 ms
DRS53.7%
Semantic56.3%
Factuality65.0%
Safety100.0%
Reliability76.0%
Hallucination57.5%
gemma22b1.6 GB
Rank #328/491
Accuracy62.2%
Latency8285 ms
DRS53.7%
Semantic50.3%
Factuality58.3%
Safety93.2%
Reliability87.8%
Hallucination60.2%
qwen3:4b4.0b2.5 GB
Rank #329/491
Accuracy63.5%
Latency44594 ms
DRS53.7%
Semantic50.9%
Factuality58.8%
Safety91.0%
Reliability89.0%
Hallucination61.7%
granite4:1b1.63b3.3 GB
Rank #330/491
Accuracy46.1%
Latency2900 ms
DRS53.7%
Semantic56.1%
Factuality62.9%
Safety100.0%
Reliability88.8%
Hallucination58.1%
interlm2.51.8b3.8 GB
Rank #331/491
Accuracy63.0%
Latency7883 ms
DRS53.4%
Semantic58.9%
Factuality67.1%
Safety100.0%
Reliability59.3%
Hallucination56.0%
gemma4:e2b~4.6 GB
Rank #332/491
Accuracy72.3%
Latency5722 ms
DRS53.4%
Semantic50.1%
Factuality60.1%
Safety71.5%
Reliability100.0%
Hallucination100.0%
qwen2.5-coder:0.5b0.5b1.1GB
Rank #333/491
Accuracy42.3%
Latency811 ms
DRS53.4%
Semantic63.3%
Factuality70.7%
Safety92.5%
Reliability37.5%
Hallucination29.3%
qwen:7b8b4.5 GB
Rank #334/491
Accuracy50.1%
Latency6623 ms
DRS53.4%
Semantic52.4%
Factuality59.9%
Safety100.0%
Reliability90.7%
Hallucination59.1%
bonsai-2:2b1.9b911 MB
Rank #335/491
Accuracy59.2%
Latency30257 ms
DRS53.4%
Semantic52.0%
Factuality59.6%
Safety94.0%
Reliability87.2%
Hallucination59.8%
Novel – 1.5B Coding Fine-tune1.5b986 MB
Rank #336/491
Accuracy61.2%
Latency1641 ms
DRS53.3%
Semantic55.0%
Factuality64.0%
Safety100.0%
Reliability33.3%
Hallucination36.0%
deepseek-r1:7b7.62b4.7 GB
Rank #337/491
Accuracy72.7%
Latency29820 ms
DRS53.3%
Semantic49.0%
Factuality59.2%
Safety100.0%
Reliability65.8%
Hallucination59.5%
lfm2-700m700m468MB
Rank #338/491
Accuracy60.1%
Latency14270 ms
DRS53.2%
Semantic47.0%
Factuality55.6%
Safety100.0%
Reliability87.4%
Hallucination61.1%
zephyr:7b7b4.1 GB
Rank #339/491
Accuracy48.0%
Latency5344 ms
DRS53.1%
Semantic52.4%
Factuality59.9%
Safety100.0%
Reliability90.9%
Hallucination58.9%
medgemma1.5:4b-it-q8_04b5.0 GB
Rank #340/491
Accuracy78.0%
Latency22582 ms
DRS53.1%
Semantic42.8%
Factuality54.3%
Safety81.0%
Reliability88.0%
Hallucination62.4%
qwen3-vl:2b2.1b1.9 GB
Rank #341/491
Accuracy59.6%
Latency32515 ms
DRS52.9%
Semantic47.8%
Factuality58.2%
Safety96.2%
Reliability87.3%
Hallucination63.0%
llama3-gradient:8b8b4.7 GB
Rank #342/491
Accuracy60.4%
Latency20708 ms
DRS52.9%
Semantic56.4%
Factuality65.1%
Safety100.0%
Reliability65.4%
Hallucination57.5%
deepseek-llm:7b7b4.0 GB
Rank #343/491
Accuracy47.8%
Latency6276 ms
DRS52.8%
Semantic54.2%
Factuality61.3%
Safety97.0%
Reliability89.2%
Hallucination58.2%
yi-coder:1.5b1.5b866 MB
Rank #344/491
Accuracy52.5%
Latency1231 ms
DRS52.8%
Semantic50.7%
Factuality59.0%
Safety99.1%
Reliability79.7%
Hallucination59.2%
KittyLM MiniCPM5 1B1b688 MB
Rank #345/491
Accuracy36.5%
Latency823 ms
DRS52.7%
Semantic62.7%
Factuality70.2%
Safety100.0%
Reliability33.3%
Hallucination29.8%
exaone3.5:2.4b2.7b1.6 GB
Rank #346/491
Accuracy58.2%
Latency15438 ms
DRS52.7%
Semantic48.1%
Factuality58.5%
Safety96.2%
Reliability86.3%
Hallucination60.4%
gemma:2b2b1.7GB
Rank #347/491
Accuracy59.6%
Latency15646 ms
DRS52.6%
Semantic45.9%
Factuality54.7%
Safety99.0%
Reliability75.9%
Hallucination60.8%
Qwen2.5-Coder-0.5B-Instruct0.5b491 MB
Rank #348/491
Accuracy79.7%
Latency1261 ms
DRS52.6%
Semantic31.9%
Factuality40.0%
Safety100.0%
Reliability33.3%
Hallucination60.0%
qwen3.5:4b4.2b3.3 GB
Rank #349/491
Accuracy63.6%
Latency39340 ms
DRS52.6%
Semantic51.4%
Factuality59.2%
Safety88.0%
Reliability83.2%
Hallucination60.5%
ministral-3:8b8.9b6.0 GB
Rank #350/491
Accuracy58.3%
Latency46927 ms
DRS52.6%
Semantic50.6%
Factuality58.5%
Safety91.0%
Reliability88.9%
Hallucination60.8%
smollm2360m725MB
Rank #351/491
Accuracy59.6%
Latency8009 ms
DRS52.5%
Semantic53.1%
Factuality61.6%
Safety97.1%
Reliability72.0%
Hallucination58.5%
stablelm2:1.6b-chat-q8_01.6b1.8 GB
Rank #352/491
Accuracy56.4%
Latency3079 ms
DRS52.5%
Semantic47.4%
Factuality55.9%
Safety100.0%
Reliability83.1%
Hallucination60.8%
llama2:7b7b3.8 GB
Rank #353/491
Accuracy56.6%
Latency18645 ms
DRS52.4%
Semantic46.9%
Factuality55.5%
Safety97.0%
Reliability90.3%
Hallucination61.0%
Qwen3 0.6B600m523MB
Rank #354/491
Accuracy56.3%
Latency14890 ms
DRS52.4%
Semantic48.0%
Factuality57.4%
Safety100.0%
Reliability84.1%
Hallucination60.4%
phi3:14b14.0b7.9 GB
Rank #355/491
Accuracy58.0%
Latency24232 ms
DRS52.4%
Semantic47.3%
Factuality55.8%
Safety97.0%
Reliability87.7%
Hallucination60.7%
smollm2:1.7b-instruct-q4_K_M1.7b1.1 GB
Rank #356/491
Accuracy60.2%
Latency2878 ms
DRS52.4%
Semantic45.9%
Factuality56.7%
Safety100.0%
Reliability78.3%
Hallucination61.5%
smollm2135m270MB
Rank #357/491
Accuracy61.6%
Latency134129 ms
DRS52.2%
Semantic52.3%
Factuality61.3%
Safety93.5%
Reliability72.1%
Hallucination58.6%
nous-hermes2:10.7b11b6.1 GB
Rank #358/491
Accuracy53.6%
Latency14500 ms
DRS52.2%
Semantic50.1%
Factuality58.1%
Safety100.0%
Reliability83.2%
Hallucination60.0%
Microsoft Phi-1.51.5b893MB
Rank #359/491
Accuracy61.5%
Latency3945 ms
DRS52.1%
Semantic61.3%
Factuality69.1%
Safety95.3%
Reliability33.3%
Hallucination30.9%
smallthinker:3b3.4b3.6 GB
Rank #360/491
Accuracy62.4%
Latency97812 ms
DRS52.1%
Semantic42.8%
Factuality54.2%
Safety100.0%
Reliability84.0%
Hallucination62.7%
Falcon-H1 1.5B1.5b915 MB
Rank #361/491
Accuracy57.6%
Latency12551 ms
DRS52.0%
Semantic45.3%
Factuality54.3%
Safety97.0%
Reliability33.3%
Hallucination45.7%
Qwen2.5-Coder 3B3b1.9 GB
Rank #362/491
Accuracy52.9%
Latency16272 ms
DRS51.9%
Semantic48.7%
Factuality58.9%
Safety100.0%
Reliability83.5%
Hallucination60.5%
Gemma 3 1B800m1gb
Rank #363/491
Accuracy51.5%
Latency27906 ms
DRS51.7%
Semantic48.7%
Factuality56.9%
Safety100.0%
Reliability85.4%
Hallucination60.9%
orca2:7b7b3.8 GB
Rank #364/491
Accuracy53.8%
Latency14524 ms
DRS51.7%
Semantic47.4%
Factuality58.0%
Safety97.0%
Reliability86.0%
Hallucination60.4%
solar:10.7b11b6.1 GB
Rank #365/491
Accuracy47.8%
Latency18318 ms
DRS51.6%
Semantic50.0%
Factuality58.0%
Safety100.0%
Reliability87.5%
Hallucination60.1%
smollm360m229MB
Rank #366/491
Accuracy64.0%
Latency40120 ms
DRS51.5%
Semantic41.0%
Factuality51.8%
Safety95.5%
Reliability85.4%
Hallucination62.5%
deepseek-r1:1.5b1.5b1.1 GB
Rank #367/491
Accuracy56.2%
Latency7669 ms
DRS51.5%
Semantic53.9%
Factuality63.1%
Safety91.0%
Reliability33.3%
Hallucination36.9%
qwen3:0.6b0.6b523 MB
Rank #368/491
Accuracy48.3%
Latency14984 ms
DRS51.5%
Semantic50.5%
Factuality59.0%
Safety98.8%
Reliability84.9%
Hallucination59.5%
gemma:2b-instruct-q8_02b2.7 GB
Rank #369/491
Accuracy48.9%
Latency3899 ms
DRS51.5%
Semantic48.7%
Factuality56.9%
Safety97.0%
Reliability87.9%
Hallucination60.2%
tinyllama:1.1b1.1b637 MB
Rank #370/491
Accuracy61.8%
Latency22028 ms
DRS51.4%
Semantic44.2%
Factuality55.3%
Safety100.0%
Reliability76.9%
Hallucination62.0%
internlm2:7b7.7b4.5 GB
Rank #371/491
Accuracy58.3%
Latency11165 ms
DRS51.4%
Semantic43.7%
Factuality53.0%
Safety97.0%
Reliability86.3%
Hallucination62.3%
stablelm21.6b982 MB
Rank #372/491
Accuracy54.3%
Latency2171 ms
DRS51.3%
Semantic45.1%
Factuality54.1%
Safety100.0%
Reliability81.1%
Hallucination61.6%
qwen20.5b352 MB
Rank #373/491
Accuracy56.0%
Latency6729 ms
DRS51.3%
Semantic51.6%
Factuality60.7%
Safety93.8%
Reliability74.3%
Hallucination58.9%
qwen3.5:2b1.9b2.7 GB
Rank #374/491
Accuracy55.5%
Latency42608 ms
DRS51.2%
Semantic48.7%
Factuality56.9%
Safety94.0%
Reliability83.9%
Hallucination61.4%
qwen2.5-instruct1.54b1.1 GB
Rank #375/491
Accuracy56.1%
Latency3478 ms
DRS50.9%
Semantic50.0%
Factuality58.0%
Safety94.0%
Reliability74.5%
Hallucination59.9%
qwen2:1.5b-instruct-q8_01.5b1.6 GB
Rank #376/491
Accuracy47.9%
Latency1781 ms
DRS50.9%
Semantic50.2%
Factuality60.1%
Safety100.0%
Reliability74.2%
Hallucination59.7%
smollm2:360m360m726MB
Rank #377/491
Accuracy53.5%
Latency4221 ms
DRS50.5%
Semantic48.5%
Factuality53.2%
Safety98.1%
Reliability76.2%
Hallucination59.8%
Sailor-0.5B-Chat0.5b407MB
Rank #378/491
Accuracy54.4%
Latency6633 ms
DRS50.5%
Semantic55.0%
Factuality64.0%
Safety96.3%
Reliability33.3%
Hallucination36.0%
Lite-Oute-1-300M-Instruct300m500MB
Rank #379/491
Accuracy36.0%
Latency619 ms
DRS50.5%
Semantic56.6%
Factuality65.3%
Safety94.0%
Reliability33.3%
Hallucination34.7%
stablelm2:12b12b7.0 GB
Rank #380/491
Accuracy46.9%
Latency7832 ms
DRS50.5%
Semantic49.0%
Factuality57.2%
Safety100.0%
Reliability81.7%
Hallucination59.8%
qwen3.5:0.8b752.39m1.3 GB
Rank #381/491
Accuracy57.9%
Latency36093 ms
DRS50.4%
Semantic45.3%
Factuality54.3%
Safety97.0%
Reliability73.8%
Hallucination60.2%
smollm2:135m-instruct-q4_K_M135m105 MB
Rank #382/491
Accuracy49.3%
Latency922 ms
DRS50.4%
Semantic45.6%
Factuality54.4%
Safety100.0%
Reliability76.3%
Hallucination60.9%
hf.co/second-state/Bielik-1.5B-v3.0-Instruct-GGUF:Q4_K_M1.6b0.97 GB
Rank #383/491
Accuracy54.8%
Latency5727 ms
DRS50.3%
Semantic47.7%
Factuality56.1%
Safety97.0%
Reliability75.2%
Hallucination60.4%
Gemma 3 270M
Rank #384/491
Accuracy36.8%
Latency3461 ms
DRS50.3%
Semantic48.7%
Factuality59.0%
Safety100.0%
Reliability87.9%
Hallucination58.9%
tinyllama:1.1b-chat1.1b637 MB
Rank #385/491
Accuracy43.6%
Latency1819 ms
DRS50.2%
Semantic50.3%
Factuality58.2%
Safety100.0%
Reliability33.3%
Hallucination41.8%
llama3.2-instruct1.0b807 MB
Rank #386/491
Accuracy47.2%
Latency3746 ms
DRS50.1%
Semantic45.8%
Factuality54.7%
Safety97.0%
Reliability85.9%
Hallucination61.4%
SmolLM2 135M1.6 billion1gb
Rank #387/491
Accuracy56.3%
Latency3971 ms
DRS50.1%
Semantic46.9%
Factuality56.5%
Safety100.0%
Reliability67.8%
Hallucination60.8%
SmolLM 1.7B1.7b1.5GB
Rank #388/491
Accuracy47.7%
Latency20377 ms
DRS50.1%
Semantic47.7%
Factuality56.2%
Safety94.0%
Reliability88.5%
Hallucination60.6%
mathstral:7b7.2b4.1 GB
Rank #389/491
Accuracy53.8%
Latency10613 ms
DRS50.1%
Semantic48.6%
Factuality58.9%
Safety97.0%
Reliability72.7%
Hallucination60.3%
Llama 3.2 1B1.23b1.3 GB
Rank #390/491
Accuracy47.5%
Latency22187 ms
DRS50.0%
Semantic46.5%
Factuality55.2%
Safety100.0%
Reliability83.9%
Hallucination61.1%
h2o-danube30.5b318 MB
Rank #391/491
Accuracy51.2%
Latency10128 ms
DRS49.9%
Semantic44.3%
Factuality53.5%
Safety100.0%
Reliability81.7%
Hallucination61.6%
FinSenti-SmolLM-1.7B1.7b1.1GB
Rank #392/491
Accuracy53.7%
Latency7057 ms
DRS49.9%
Semantic44.3%
Factuality53.5%
Safety97.0%
Reliability33.3%
Hallucination46.5%
deepseek-r1-distill-qwen1.5b1.1 GB
Rank #393/491
Accuracy69.6%
Latency9924 ms
DRS49.8%
Semantic39.3%
Factuality51.4%
Safety100.0%
Reliability64.0%
Hallucination63.7%
Qwen3.5 0.8B800m574MB
Rank #394/491
Accuracy56.9%
Latency92785 ms
DRS49.8%
Semantic42.7%
Factuality52.2%
Safety100.0%
Reliability76.1%
Hallucination61.4%
TinyDolphin1.1b636MB
Rank #395/491
Accuracy54.0%
Latency9229 ms
DRS49.6%
Semantic46.6%
Factuality56.3%
Safety100.0%
Reliability70.7%
Hallucination60.9%
Security-SLM 1.5B1.5b1.1 GB
Rank #396/491
Accuracy64.2%
Latency7225 ms
DRS49.5%
Semantic51.0%
Factuality60.8%
Safety77.4%
Reliability33.3%
Hallucination39.2%
InstructLM 1.3B1.3b821 MB
Rank #397/491
Accuracy57.3%
Latency8644 ms
DRS49.5%
Semantic50.1%
Factuality60.1%
Safety88.7%
Reliability33.3%
Hallucination39.9%
qwen2:0.5b-instruct-q8_00.5b531 MB
Rank #398/491
Accuracy36.8%
Latency537 ms
DRS49.3%
Semantic53.3%
Factuality60.6%
Safety100.0%
Reliability69.0%
Hallucination58.2%
tinyllama:latest1.1b637MB
Rank #399/491
Accuracy56.7%
Latency8466 ms
DRS49.2%
Semantic46.0%
Factuality51.8%
Safety100.0%
Reliability75.3%
Hallucination61.2%
smollm135m91MB
Rank #400/491
Accuracy56.8%
Latency12748 ms
DRS49.1%
Semantic38.6%
Factuality49.9%
Safety100.0%
Reliability78.2%
Hallucination63.5%
granite-code:3b3.5b2.0 GB
Rank #401/491
Accuracy46.0%
Latency17980 ms
DRS49.0%
Semantic52.0%
Factuality59.6%
Safety97.0%
Reliability71.9%
Hallucination59.4%
tinyllama:1.1b-chat-v1-q8_01.1b1.2 GB
Rank #402/491
Accuracy40.8%
Latency3084 ms
DRS48.9%
Semantic47.1%
Factuality55.7%
Safety100.0%
Reliability80.8%
Hallucination61.1%
olmo1b791 MB
Rank #403/491
Accuracy46.3%
Latency15029 ms
DRS48.7%
Semantic42.9%
Factuality52.4%
Safety100.0%
Reliability83.5%
Hallucination62.5%
GRAFT-1B:Q6_K1b971 MB
Rank #404/491
Accuracy38.4%
Latency2583 ms
DRS48.5%
Semantic44.7%
Factuality53.8%
Safety100.0%
Reliability33.3%
Hallucination46.2%
qwen2.5-coder0.5b397MB
Rank #405/491
Accuracy49.0%
Latency7207 ms
DRS48.4%
Semantic46.9%
Factuality57.2%
Safety94.6%
Reliability72.8%
Hallucination60.4%
sailor2:8b8.5b5.2 GB
Rank #406/491
Accuracy55.3%
Latency26403 ms
DRS48.2%
Semantic43.8%
Factuality51.0%
Safety90.0%
Reliability77.0%
Hallucination54.3%
phi-4-mini-instruct4.0b2.5 GB
Rank #407/491
Accuracy57.4%
Latency70452 ms
DRS48.1%
Semantic48.5%
Factuality57.5%
Safety82.0%
Reliability69.2%
Hallucination59.2%
TAU-Instruct-0.5B0.5b407mb
Rank #408/491
Accuracy34.7%
Latency473 ms
DRS48.1%
Semantic55.8%
Factuality64.7%
Safety100.0%
Reliability33.3%
Hallucination35.3%
Stable LM 2 1.6B Chat1.6b983 MB
Rank #409/491
Accuracy45.3%
Latency2886 ms
DRS48.1%
Semantic46.0%
Factuality54.8%
Safety89.4%
Reliability33.3%
Hallucination45.2%
atlas-coder0.5b531 Mb
Rank #410/491
Accuracy51.2%
Latency157380 ms
DRS48.0%
Semantic40.4%
Factuality52.3%
Safety97.0%
Reliability77.8%
Hallucination63.7%
SmolLM2 360M82million100 MB
Rank #411/491
Accuracy44.1%
Latency7134 ms
DRS48.0%
Semantic49.6%
Factuality57.7%
Safety100.0%
Reliability68.2%
Hallucination60.4%
starcoder2:latest3b1.7 GB
Rank #412/491
Accuracy51.1%
Latency15127 ms
DRS47.9%
Semantic58.4%
Factuality66.7%
Safety95.3%
Reliability35.4%
Hallucination33.3%
Qwen3 0.6B0.6 b523 MB
Rank #413/491
Accuracy37.5%
Latency15554 ms
DRS47.9%
Semantic45.0%
Factuality54.0%
Safety100.0%
Reliability86.3%
Hallucination62.0%
llama3.2:1b1.24b1.3 GB
Rank #414/491
Accuracy43.5%
Latency10929 ms
DRS47.5%
Semantic42.7%
Factuality52.2%
Safety97.0%
Reliability81.7%
Hallucination62.5%
qwen1.50.5b394 MB
Rank #415/491
Accuracy33.1%
Latency723 ms
DRS47.4%
Semantic47.9%
Factuality56.3%
Safety97.0%
Reliability75.3%
Hallucination60.4%
Qwen3 0.6B0.6b523 MB
Rank #416/491
Accuracy33.9%
Latency46276 ms
DRS47.4%
Semantic46.0%
Factuality54.8%
Safety100.0%
Reliability86.3%
Hallucination61.9%
smollm2:360m-instruct-q4_K_M360m271 MB
Rank #417/491
Accuracy32.6%
Latency387 ms
DRS47.3%
Semantic47.3%
Factuality57.9%
Safety100.0%
Reliability68.8%
Hallucination60.8%
deepseek-coder:1.3b1.3b776 MB
Rank #418/491
Accuracy36.8%
Latency5498 ms
DRS46.9%
Semantic44.5%
Factuality53.3%
Safety97.3%
Reliability71.1%
Hallucination58.3%
Cerebras-GPT-1.3B-Alpaca-SP1.3b874 MB
Rank #419/491
Accuracy49.3%
Latency859 ms
DRS46.8%
Semantic43.9%
Factuality55.1%
Safety100.0%
Reliability33.3%
Hallucination44.9%
smollm2:360m-instruct-q8_0361.82m386 MB
Rank #420/491
Accuracy37.2%
Latency2786 ms
DRS46.8%
Semantic48.8%
Factuality57.0%
Safety100.0%
Reliability67.8%
Hallucination60.2%
entity12208/editorai:v21.5b941 MB
Rank #421/491
Accuracy36.4%
Latency574 ms
DRS46.7%
Semantic39.7%
Factuality51.8%
Safety100.0%
Reliability58.9%
Hallucination57.0%
Falcon3-1B-Instruct1b1.1GB
Rank #422/491
Accuracy56.7%
Latency1351 ms
DRS46.7%
Semantic31.3%
Factuality37.1%
Safety100.0%
Reliability53.3%
Hallucination62.9%
SmolLM2 360M360m230 MB
Rank #423/491
Accuracy34.3%
Latency5032 ms
DRS46.6%
Semantic51.7%
Factuality59.4%
Safety100.0%
Reliability66.6%
Hallucination59.2%
qwen3.5:4b4b3.3 GB
Rank #424/491
Accuracy51.3%
Latency37698 ms
DRS46.5%
Semantic42.2%
Factuality47.8%
Safety92.4%
Reliability69.9%
Hallucination60.7%
falcon:7b-instruct7b4.2 GB
Rank #425/491
Accuracy30.0%
Latency513 ms
DRS46.0%
Semantic48.5%
Factuality54.8%
Safety100.0%
Reliability66.6%
Hallucination60.1%
qwen:1.8b1.8b1.1 GB
Rank #426/491
Accuracy35.5%
Latency14399 ms
DRS45.9%
Semantic46.7%
Factuality55.4%
Safety93.2%
Reliability78.6%
Hallucination60.6%
Supra2-100M-Instruct100m202 MB
Rank #427/491
Accuracy51.0%
Latency1016 ms
DRS45.8%
Semantic33.7%
Factuality34.9%
Safety100.0%
Reliability33.3%
Hallucination65.1%
Qwen2.5-Coder 0.5B0.49b398 MB
Rank #428/491
Accuracy40.6%
Latency4701 ms
DRS45.7%
Semantic39.0%
Factuality51.2%
Safety100.0%
Reliability73.8%
Hallucination63.0%
sailor2:1b1b738MB
Rank #429/491
Accuracy44.0%
Latency7566 ms
DRS45.3%
Semantic41.8%
Factuality51.4%
Safety89.4%
Reliability75.3%
Hallucination62.8%
qwen2.5:0.5b0.5b398 MB
Rank #430/491
Accuracy38.7%
Latency5656 ms
DRS45.0%
Semantic41.4%
Factuality51.1%
Safety91.0%
Reliability79.1%
Hallucination62.9%
mistrallite:7b7b4.1 GB
Rank #431/491
Accuracy45.0%
Latency5116 ms
DRS44.7%
Semantic48.2%
Factuality58.6%
Safety100.0%
Reliability43.1%
Hallucination59.4%
TAU-Instruct 0.5B5b407 MB
Rank #432/491
Accuracy34.8%
Latency294 ms
DRS44.5%
Semantic45.7%
Factuality56.5%
Safety100.0%
Reliability33.3%
Hallucination43.5%
deepseek-coder:6.7b6.7b3.8 GB
Rank #433/491
Accuracy32.9%
Latency3923 ms
DRS44.4%
Semantic38.0%
Factuality48.9%
Safety100.0%
Reliability78.0%
Hallucination63.6%
functiongemma270m (0.27b)300 MB
Rank #434/491
Accuracy17.1%
Latency2725 ms
DRS44.0%
Semantic46.6%
Factuality57.3%
Safety100.0%
Reliability77.6%
Hallucination60.4%
bespoke-minicheck:7b7b4.7 GB
Rank #435/491
Accuracy0.0%
Latency222 ms
DRS44.0%
Semantic16.7%
Factuality31.4%
Safety100.0%
Reliability100.0%
Hallucination54.2%
sqlcoder:7b7b4.1 GB
Rank #436/491
Accuracy32.2%
Latency264933 ms
DRS43.8%
Semantic56.7%
Factuality65.4%
Safety100.0%
Reliability42.9%
Hallucination56.8%
MNN-Pocket-0.3B-Instruct300 million191 MB
Rank #437/491
Accuracy24.7%
Latency210 ms
DRS43.6%
Semantic47.9%
Factuality58.4%
Safety100.0%
Reliability33.3%
Hallucination41.6%
Coral 1.7 Micro1.48b1.6 GB
Rank #438/491
Accuracy29.6%
Latency5502 ms
DRS43.6%
Semantic42.5%
Factuality52.0%
Safety100.0%
Reliability63.6%
Hallucination59.6%
ThoxAir-0.5B0.5b397 MB
Rank #439/491
Accuracy24.7%
Latency410 ms
DRS43.3%
Semantic50.4%
Factuality60.3%
Safety97.0%
Reliability33.3%
Hallucination39.7%
Llamargy-1B-Instruct1b580 MB
Rank #440/491
Accuracy35.0%
Latency31858 ms
DRS43.3%
Semantic47.7%
Factuality58.2%
Safety100.0%
Reliability33.3%
Hallucination41.8%
granite3-guardian:2b2b2.7 GB
Rank #441/491
Accuracy0.0%
Latency77 ms
DRS43.3%
Semantic11.8%
Factuality29.4%
Safety100.0%
Reliability100.0%
Hallucination55.9%
llama-guard3:1b1b1.6 GB
Rank #442/491
Accuracy0.0%
Latency42 ms
DRS43.2%
Semantic11.1%
Factuality28.9%
Safety100.0%
Reliability100.0%
Hallucination56.1%
SmolLM2135M135m271 MB
Rank #443/491
Accuracy26.6%
Latency4372 ms
DRS43.0%
Semantic40.4%
Factuality50.3%
Safety100.0%
Reliability73.6%
Hallucination63.1%
llama-guard3:8b8b4.9 GB
Rank #444/491
Accuracy0.0%
Latency102 ms
DRS42.8%
Semantic10.1%
Factuality28.1%
Safety100.0%
Reliability100.0%
Hallucination56.5%
starcoder2:7b7b4.0 GB
Rank #445/491
Accuracy40.2%
Latency22605 ms
DRS42.5%
Semantic41.3%
Factuality53.1%
Safety100.0%
Reliability51.5%
Hallucination62.4%
OpenELM-1_1B1b1.1 GB
Rank #446/491
Accuracy34.9%
Latency9136 ms
DRS41.8%
Semantic40.0%
Factuality50.0%
Safety96.2%
Reliability33.3%
Hallucination50.0%
hf.co/dengcao/ERNIE-4.5-0.3B-PT-GGUF:Q4_K_M0.3b240MB
Rank #447/491
Accuracy26.8%
Latency341 ms
DRS41.7%
Semantic32.0%
Factuality43.6%
Safety100.0%
Reliability69.5%
Hallucination65.5%
StarCoder 1B1b726 MB
Rank #448/491
Accuracy44.8%
Latency12723 ms
DRS41.5%
Semantic41.5%
Factuality53.2%
Safety91.5%
Reliability33.3%
Hallucination46.8%
falcon3:10b10.3b6.3 GB
Rank #449/491
Accuracy35.1%
Latency14469 ms
DRS41.5%
Semantic33.7%
Factuality41.0%
Safety100.0%
Reliability61.9%
Hallucination62.3%
ShieldGemma 2B2b1.7 GB
Rank #450/491
Accuracy0.0%
Latency669 ms
DRS41.0%
Semantic7.1%
Factuality25.7%
Safety100.0%
Reliability100.0%
Hallucination57.5%
meditron:7b7b3.8 GB
Rank #451/491
Accuracy42.1%
Latency12164 ms
DRS40.8%
Semantic39.7%
Factuality51.7%
Safety100.0%
Reliability39.7%
Hallucination62.8%
GPT2-Dolly91.2 mb91 MB
Rank #452/491
Accuracy43.6%
Latency10858 ms
DRS40.5%
Semantic36.9%
Factuality49.5%
Safety93.7%
Reliability33.3%
Hallucination50.5%
KittyLM MiniCPM51b688 MB
Rank #453/491
Accuracy14.8%
Latency377 ms
DRS40.0%
Semantic37.0%
Factuality49.6%
Safety100.0%
Reliability63.0%
Hallucination63.7%
deepcoder1.5b1.1 GB
Rank #454/491
Accuracy30.7%
Latency228 ms
DRS39.6%
Semantic34.8%
Factuality47.9%
Safety100.0%
Reliability38.7%
Hallucination63.4%
smollm2:135m135m270 MB
Rank #455/491
Accuracy74.6%
Latency1483 ms
DRS38.4%
Semantic45.7%
Factuality46.8%
Safety100.0%
Reliability53.5%
Hallucination50.8%
amd-olmo-1b-sft1b479mb
Rank #456/491
Accuracy33.4%
Latency62537 ms
DRS38.2%
Semantic27.5%
Factuality42.0%
Safety100.0%
Reliability58.4%
Hallucination67.4%
codegemma:2b2b1.6 GB
Rank #457/491
Accuracy33.5%
Latency6208 ms
DRS38.2%
Semantic35.0%
Factuality48.0%
Safety100.0%
Reliability37.1%
Hallucination62.9%
BLOOM-560M560m561 MB
Rank #458/491
Accuracy29.5%
Latency4019 ms
DRS38.0%
Semantic36.5%
Factuality49.2%
Safety95.3%
Reliability33.3%
Hallucination50.8%
TituLM-MPT-1B-v2.01b911 MB
Rank #459/491
Accuracy38.6%
Latency14342 ms
DRS37.3%
Semantic32.9%
Factuality46.3%
Safety93.7%
Reliability33.3%
Hallucination53.7%
Navya-1 1B-SFT337m700 MB
Rank #460/491
Accuracy14.8%
Latency9428 ms
DRS37.0%
Semantic32.2%
Factuality43.8%
Safety100.0%
Reliability72.7%
Hallucination65.7%
openelm0.45b289 MB
Rank #461/491
Accuracy22.9%
Latency11827 ms
DRS36.9%
Semantic34.3%
Factuality45.5%
Safety100.0%
Reliability52.0%
Hallucination65.4%
Pythia 410M410m267 MB
Rank #462/491
Accuracy47.2%
Latency18768 ms
DRS36.8%
Semantic30.0%
Factuality44.0%
Safety83.4%
Reliability33.3%
Hallucination56.0%
starcoder:7b7b4.3 GB
Rank #463/491
Accuracy31.9%
Latency43202 ms
DRS36.2%
Semantic38.9%
Factuality51.1%
Safety94.0%
Reliability31.7%
Hallucination63.2%
supra-50m-instruct0.0518b104 MB
Rank #464/491
Accuracy37.3%
Latency581 ms
DRS35.8%
Semantic25.1%
Factuality25.1%
Safety100.0%
Reliability44.3%
Hallucination68.2%
duckdb-nsql:7b7b3.8 GB
Rank #465/491
Accuracy2.6%
Latency30842 ms
DRS35.8%
Semantic27.4%
Factuality41.9%
Safety100.0%
Reliability78.2%
Hallucination65.5%
DistilGPT282 million84 MB
Rank #466/491
Accuracy28.7%
Latency616 ms
DRS34.1%
Semantic31.1%
Factuality44.9%
Safety100.0%
Reliability33.3%
Hallucination55.1%
Aira-2-774M774m774M
Rank #467/491
Accuracy30.7%
Latency2459 ms
DRS33.6%
Semantic18.2%
Factuality16.6%
Safety100.0%
Reliability33.3%
Hallucination83.4%
phi-33.8b2.2 GB
Rank #468/491
Accuracy27.3%
Latency9997 ms
DRS33.3%
Semantic20.0%
Factuality36.0%
Safety95.3%
Reliability51.2%
Hallucination70.0%
ernie-4.50.3b220mb
Rank #469/491
Accuracy82.0%
Latency3049 ms
DRS32.7%
Semantic20.7%
Factuality36.6%
Safety100.0%
Reliability61.2%
Hallucination69.8%
bloom560m539MB
Rank #470/491
Accuracy35.8%
Latency20277 ms
DRS32.4%
Semantic24.5%
Factuality38.9%
Safety97.0%
Reliability24.8%
Hallucination68.8%
256M Alpaca256m0.3B
Rank #471/491
Accuracy28.5%
Latency23075 ms
DRS31.3%
Semantic20.8%
Factuality36.6%
Safety100.0%
Reliability33.3%
Hallucination63.4%
bloom-560m0.8b1.6 GB
Rank #472/491
Accuracy37.7%
Latency7540 ms
DRS30.5%
Semantic22.7%
Factuality23.1%
Safety100.0%
Reliability17.1%
Hallucination66.9%
BLOOM 560M560m561 MB
Rank #473/491
Accuracy34.1%
Latency5804 ms
DRS30.5%
Semantic25.0%
Factuality40.0%
Safety86.4%
Reliability33.3%
Hallucination60.0%
pythia0.41b267mb
Rank #474/491
Accuracy21.7%
Latency9333 ms
DRS30.2%
Semantic23.3%
Factuality33.8%
Safety100.0%
Reliability32.5%
Hallucination69.0%
qwen3:1.7b1.7b1.4 GB
Rank #475/491
Accuracy76.3%
Latency16626 ms
DRS29.6%
Semantic52.1%
Factuality61.0%
Safety46.6%
Reliability43.3%
Hallucination28.7%
asena-esp320.121b2.7 MB
Rank #476/491
Accuracy19.7%
Latency1677 ms
DRS28.3%
Semantic6.1%
Factuality24.9%
Safety100.0%
Reliability47.2%
Hallucination74.5%
willow-alpha0.3b176 MB
Rank #477/491
Accuracy12.4%
Latency303 ms
DRS28.2%
Semantic11.9%
Factuality29.6%
Safety100.0%
Reliability31.3%
Hallucination71.7%
Falcon3-3B-Instruct3b2gb
Rank #478/491
Accuracy13.2%
Latency1290 ms
DRS25.5%
Semantic9.7%
Factuality11.7%
Safety100.0%
Reliability3.0%
Hallucination60.0%
minicpm51.0b688 MB
Rank #479/491
Accuracy0.0%
Latency409 ms
DRS25.2%
Semantic5.2%
Factuality12.2%
Safety100.0%
Reliability45.6%
Hallucination71.3%
DistilGPT287m84MB
Rank #480/491
Accuracy23.3%
Latency1211 ms
DRS25.1%
Semantic10.4%
Factuality13.3%
Safety100.0%
Reliability33.3%
Hallucination86.7%
falcon3:3b-instruct-q8_03b3.4 GB
Rank #481/491
Accuracy7.5%
Latency1262 ms
DRS23.7%
Semantic7.0%
Factuality7.6%
Safety100.0%
Reliability3.2%
Hallucination60.1%
LFM2.5 Thinking1.17b731 MB
Rank #482/491
Accuracy46.9%
Latency692505 ms
DRS22.8%
Semantic15.3%
Factuality23.5%
Safety100.0%
Reliability74.6%
Hallucination31.4%
TinyBrainBot-53M-A9M-Hybrid-Instruct53.43m108MB
Rank #483/491
Accuracy24.7%
Latency1571 ms
DRS22.5%
Semantic5.5%
Factuality24.4%
Safety86.0%
Reliability33.3%
Hallucination75.6%
CodeInverter CIM-1.3B1.3b873 MB
Rank #484/491
Accuracy6.5%
Latency1764 ms
DRS21.5%
Semantic10.0%
Factuality24.0%
Safety100.0%
Reliability33.3%
Hallucination76.0%
SeaLLMs-v31.5b986 MB
Rank #485/491
Accuracy6.5%
Latency1764 ms
DRS21.5%
Semantic10.0%
Factuality24.0%
Safety100.0%
Reliability33.3%
Hallucination76.0%
falcon3:3b3b2.0 GB
Rank #486/491
Accuracy0.0%
Latency64 ms
DRS20.7%
Semantic0.0%
Factuality0.0%
Safety100.0%
Reliability2.9%
Hallucination64.1%
reader-lm:1.5b1.5b1.5GB
Rank #487/491
Accuracy19.8%
Latency837 ms
DRS17.6%
Semantic20.7%
Factuality21.9%
Safety18.7%
Reliability22.4%
Hallucination13.2%
Qwen2.5 0.5B500m
Rank #488/491
Accuracy0.0%
Latency0 ms
DRS0.0%
Semantic0.0%
Factuality0.0%
Safety0.0%
Reliability0.0%
Hallucination0.0%
OpenELM 450M450m
Rank #489/491
Accuracy0.0%
Latency0 ms
DRS0.0%
Semantic0.0%
Factuality0.0%
Safety0.0%
Reliability0.0%
Hallucination0.0%
deepseek-r1:1.5b-qwen-distill-q8_01.8b1.9 GB
Rank #490/491
Accuracy0.0%
Latency0 ms
DRS0.0%
Semantic0.0%
Factuality0.0%
Safety0.0%
Reliability0.0%
Hallucination0.0%
Llama 3.18b
Rank #491/491
Accuracy0.0%
Latency0 ms
DRS0.0%
Semantic0.0%
Factuality0.0%
Safety0.0%
Reliability0.0%
Hallucination0.0%
iShowing 491 evaluated records from OpenVals Performance & Trust validation suite.
VIEW METHODOLOGY

Research, books, media, and IEEE publications behind the trust layer.

View founder profile
14

IEEE-indexed AI and ML publications

2

Authored books across cyber and law

Media

Forbes, TradeFlock, Elets, and more

Forbes
TradeFlock
Elets Healthcare
Blindwink
Pride India Awards
The CConnects
And more...
Engagement packages

Start with the right level of AI assurance.

Full validation engagement

Enterprise AI Validation

A deeper evaluation of model quality, safety, reliability, bias, and deployment readiness.

Scoped program
Adversarial testing

AI Security

Manual and automated pressure testing for jailbreaks, prompt injection, leakage, and abuse cases.

Attack simulation
Audit preparation

Compliance Readiness

Evidence, controls, and governance artifacts for teams preparing for AI oversight.

Regulatory support

Book Your AI Trust

Get a fast baseline of your model's reliability, safety, compliance, and deployment risk before you invest in a full validation program.