Models

llama31-8b-16k
meta-llama/Meta-Llama-3.1-8B-Instruct
Warm
2,618
3,144,344
llama3-8b-8k
meta-llama/Meta-Llama-3-8B-Instruct
Warm
3,482
2,117,269
llama3-8b-8k
meta-llama/Meta-Llama-3-8B
Warm
5,723
1,704,839
mistral-v02-7b-std-lc
HuggingFaceH4/zephyr-7b-beta
Warm
1,583
1,216,805
mistral-v02-7b-std-lc
mistralai/Mistral-7B-Instruct-v0.2
Loading
2,542
965,631
llama2-13b-4k
meta-llama/Llama-2-13b-chat-hf
Warm
1,019
641,959
llama3-70b-8k
meta-llama/Meta-Llama-3.1-70B-Instruct
Warm
514
591,790
llama31-8b-16k
meta-llama/Meta-Llama-3.1-8B
Warm
880
564,623
llama3-405b-lc
meta-llama/Meta-Llama-3.1-405B
Loading
810
550,930
llama3-8b-8k
beomi/Llama-3-Open-Ko-8B
Warm
124
538,609
llama31-8b-16k
NousResearch/Meta-Llama-3.1-8B-Instruct
Warm
25
210,406
llama3-70b-8k
meta-llama/Meta-Llama-3-70B-Instruct
Warm
1,403
164,888
llama3-8b-8k
aaditya/Llama3-OpenBioLLM-8B
Warm
149
148,643
qwen2-72b-lc
Qwen/Qwen2.5-72B-Instruct
Warm
297
130,245
llama2-13b-4k
lmsys/vicuna-13b-v1.5
Warm
208
127,465
mistral-v02-7b-std-lc
Intel/neural-chat-7b-v3-3
Warm
75
111,829
llama3-8b-8k
DeepMount00/Llama-3-8b-Ita
Warm
23
105,475
mistral-nemo-12b-lc
mistralai/Mistral-Nemo-Instruct-2407
Warm
1,100
99,469
llama3-8b-8k
MLP-KTLim/llama-3-Korean-Bllossom-8B
Warm
261
98,116
llama3-8b-8k
scb10x/llama-3-typhoon-v1.5-8b-instruct
Warm
24
89,859