Models

Warm

qwen2-7b-lc

Qwen/Qwen2-7B-Instruct

648

14,549,384

Q
Warm

llama31-8b-16k

meta-llama/Llama-3.1-8B-Instruct

4,269

5,462,088

M
Warm

llama31-8b-16k

meta-llama/Meta-Llama-3.1-8B-Instruct

4,269

5,462,088

M
Warm

qwen25-14b-lc

Qwen/Qwen2.5-14B-Instruct

245

4,565,304

Q
Warm

qwen25-7b-lc

Qwen/Qwen2.5-7B-Instruct-1M

336

2,187,861

Q
Warm

qwen25-7b-lc

Qwen/Qwen2.5-7B-Instruct

720

1,994,560

Q
Warm

mistral-v02-7b-std-lc

mistralai/Mistral-7B-Instruct-v0.2

2,850

1,707,086

M
Warm

qwen3-8b

Qwen/Qwen3-8B

445

1,656,466

Q
Warm

qwen3-8b

Qwen/Qwen3-8B-Base

39

1,586,114

Q
Warm

qwen3-1b7

Qwen/Qwen3-1.7B

182

1,441,540

Q
Warm

llama3-8b-8k

meta-llama/Meta-Llama-3-8B-Instruct

4,054

1,435,536

M
Warm

qwen25-1b5

Qwen/Qwen2.5-1.5B-Instruct

469

1,413,222

Q
Warm

llama3-8b-8k

Orenguteng/Llama-3-8B-Lexi-Uncensored

241

1,175,089

O
Warm

llama31-8b-16k

deepseek-ai/DeepSeek-R1-Distill-Llama-8B

763

1,099,578

D
Warm

tinyllama-1b1

TinyLlama/TinyLlama-1.1B-Chat-v1.0

1,322

1,025,938

T
Warm

qwen25-7b-lc

Qwen/Qwen2.5-7B

197

1,002,810

Q
Warm

llama31-8b-16k

meta-llama/Llama-3.1-8B

1,681

806,377

M
Warm

llama31-8b-16k

meta-llama/Meta-Llama-3.1-8B

1,681

806,377

M
Warm

qwen3-14b

Qwen/Qwen3-14B

206

778,184

Q
Warm

llama31-70b-16k

meta-llama/Meta-Llama-3.1-70B-Instruct

825

689,527

M