Models

llama31-8b-16k
meta-llama/Meta-Llama-3.1-8B-Instruct
Warm
2,618
3,144,344
llama3-8b-8k
meta-llama/Meta-Llama-3-8B-Instruct
Warm
3,627
2,555,278
mistral-v02-7b-std-lc
mistralai/Mistral-7B-Instruct-v0.2
Loading
2,578
887,913
llama2-13b-4k
meta-llama/Llama-2-13b-chat-hf
Warm
1,029
822,512
llama3-8b-8k
meta-llama/Meta-Llama-3-8B
Warm
5,836
706,267
llama31-70b-16k
meta-llama/Meta-Llama-3.1-70B-Instruct
Warm
514
591,790
mistral-v02-7b-std-lc
HuggingFaceH4/zephyr-7b-beta
Warm
1,608
567,792
llama31-8b-16k
meta-llama/Meta-Llama-3.1-8B
Warm
880
564,623
qwen2-72b-lc
Qwen/Qwen2.5-72B-Instruct
Warm
485
440,313
llama31-8b-16k
VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct
Warm
32
240,770
llama31-70b-16k
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
Warm
1,697
218,295
llama3-70b-8k
meta-llama/Meta-Llama-3-70B-Instruct
Warm
1,434
167,700
llama31-8b-16k
NousResearch/Meta-Llama-3.1-8B-Instruct
Warm
30
167,283
llama2-solar-10b7-4k
upstage/SOLAR-10.7B-Instruct-v1.0
Warm
614
151,224
mistral-nemo-12b-lc
mistralai/Mistral-Nemo-Instruct-2407
Warm
1,232
144,158
llama3-8b-8k
defog/llama-3-sqlcoder-8b
Warm
194
141,028
llama3-8b-8k
DeepMount00/Llama-3-8b-Ita
Warm
23
111,506
llama3-8b-8k
sethuiyer/Medichat-Llama3-8B
Warm
23
103,694
llama31-8b-16k
unsloth/Meta-Llama-3.1-8B-Instruct
Warm
32
95,901
llama3-8b-8k
MLP-KTLim/llama-3-Korean-Bllossom-8B
Warm
279
94,576