Models

llama31-8b-16k
meta-llama/Meta-Llama-3.1-8B-Instruct
Warm
2,527
4,112,564
llama3-8b-8k
meta-llama/Meta-Llama-3-8B
Warm
5,666
2,162,879
llama3-8b-8k
meta-llama/Meta-Llama-3-8B-Instruct
Warm
3,427
2,056,970
llama31-8b-16k
meta-llama/Meta-Llama-3.1-8B
Warm
852
561,395
mistral-v02-7b-std-lc
HuggingFaceH4/zephyr-7b-beta
Warm
1,570
519,967
llama3-405b-lc
meta-llama/Meta-Llama-3.1-405B
Loading
805
485,922
llama3-70b-8k
meta-llama/Meta-Llama-3.1-70B-Instruct
Warm
494
476,952
llama3-70b-8k
meta-llama/Meta-Llama-3-70B-Instruct
Warm
1,392
207,908
mistral-nemo-12b-lc
mistralai/Mistral-Nemo-Instruct-2407
Warm
1,072
189,838
llama31-8b-16k
unsloth/Meta-Llama-3.1-8B
Warm
27
183,537
llama31-8b-16k
NousResearch/Meta-Llama-3.1-8B-Instruct
Warm
18
174,553
llama3-8b-8k
aaditya/Llama3-OpenBioLLM-8B
Warm
141
167,579
mistral-v02-7b-std-lc
Intel/neural-chat-7b-v3-3
Warm
74
147,641
qwen2-72b-lc
Qwen/Qwen2-72B-Instruct
Warm
659
105,301
llama3-8b-8k
MLP-KTLim/llama-3-Korean-Bllossom-8B
Warm
252
85,733
llama31-70b-16k
meta-llama/Meta-Llama-3.1-70B
Warm
256
82,767
llama2-13b-4k
lmsys/vicuna-13b-v1.5
Warm
208
77,889
llama31-8b-16k
unsloth/Meta-Llama-3.1-8B-Instruct
Warm
21
61,789
llama3-405b-lc
meta-llama/Meta-Llama-3.1-405B-Instruct
Warm
464
60,528
llama3-8b-8k
NousResearch/Meta-Llama-3-8B-Instruct
Warm
79
59,238