Models

llama31-8b-16k
meta-llama/Meta-Llama-3.1-8B-Instruct
Warm
3,646
6,120,589
deepseek-v3-lc
deepseek-ai/DeepSeek-R1
Warm
9,710
4,294,810
mistral-v02-7b-std-lc
mistralai/Mistral-7B-Instruct-v0.2
Loading
2,656
3,755,668
llama3-8b-8k
meta-llama/Meta-Llama-3-8B-Instruct
Warm
3,831
1,789,243
qwen25-7b-lc
Qwen/Qwen2.5-7B-Instruct
Warm
498
1,599,222
llama31-8b-16k
meta-llama/Meta-Llama-3.1-8B
Warm
1,429
1,213,126
qwen25-32b-lc
deepseek-ai/DeepSeek-R1-Distill-Qwen-32B
Warm
1,126
933,311
qwen25-7b-lc
deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
Warm
465
805,941
llama31-8b-16k
deepseek-ai/DeepSeek-R1-Distill-Llama-8B
Warm
560
771,064
mistral3-24b-lc
mistralai/Mistral-Small-24B-Instruct-2501
Warm
790
722,465
mistral-nemo-12b-lc
Epiculous/Violet_Twilight-v0.2
Warm
29
553,893
llama3-8b-8k
meta-llama/Meta-Llama-3-8B
Warm
6,038
550,257
qwen25-14b-lc
deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
Warm
412
528,474
qwen2-7b-lc
Qwen/Qwen2-7B-Instruct
Cold
615
515,109
llama33-70b-16k
meta-llama/Llama-3.3-70B-Instruct
Warm
1,997
509,451
llama33-70b-16k
unsloth/Llama-3.3-70B-Instruct
Warm
38
449,799
llama33-70b-16k
deepseek-ai/DeepSeek-R1-Distill-Llama-70B
Warm
573
439,341
qwen25-32b-lc
Qwen/Qwen2.5-32B-Instruct
Warm
209
426,664
qwen25-14b-lc
Qwen/Qwen2.5-14B-Instruct
Warm
191
407,105
llama31-70b-16k
meta-llama/Meta-Llama-3.1-70B-Instruct
Warm
789
379,448