Models

Warm

llama31-8b-16k

meta-llama/Meta-Llama-3.1-8B-Instruct

3,784

6,047,201

M
Warm

qwen25-7b-lc

Qwen/Qwen2.5-7B-Instruct

673

3,469,637

Q
Warm

qwen25-7b-lc

Qwen/Qwen2.5-7B-Instruct-1M

323

2,294,318

Q
Warm

mistral-v02-7b-std-lc

mistralai/Mistral-7B-Instruct-v0.2

2,758

1,911,517

M
Warm

llama3-8b-8k

meta-llama/Meta-Llama-3-8B-Instruct

3,960

1,494,205

M
Warm

llama3-8b-8k

meta-llama/Meta-Llama-3-8B

6,171

1,228,462

M
Warm

llama31-70b-16k

meta-llama/Meta-Llama-3.1-70B-Instruct

805

1,197,622

M
Warm

qwen25-32b-lc

deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

1,368

1,117,639

D
Warm

llama31-8b-16k

deepseek-ai/DeepSeek-R1-Distill-Llama-8B

723

1,115,749

D
Warm

llama31-8b-16k

meta-llama/Meta-Llama-3.1-8B

1,531

986,413

M
Warm

deepseek-v3-lc

deepseek-ai/DeepSeek-R1

12,163

983,984

D
Warm

gemma3-27b

google/gemma-3-27b-it

1,099

964,080

G
Warm

llama33-70b-16k

meta-llama/Llama-3.3-70B-Instruct

2,318

926,612

M
Warm

qwen25-7b-lc

deepseek-ai/DeepSeek-R1-Distill-Qwen-7B

641

809,589

D
Warm

qwen25-14b-lc

Qwen/Qwen2.5-14B-Instruct

233

711,370

Q
Warm

qwen25-14b-lc

deepseek-ai/DeepSeek-R1-Distill-Qwen-14B

510

653,765

D
Warm

mistral-v02-7b-std-lc

HuggingFaceH4/zephyr-7b-beta

1,711

627,917

H
Warm

mistral-24b-lc

mistralai/Mistral-Small-24B-Instruct-2501

911

558,298

M
Warm

mistral-nemo-12b-lc

Nitral-AI/Captain-Eris_Violet-V0.420-12B

40

532,663

N
Warm

qwen25-32b-lc

Qwen/Qwen2.5-32B-Instruct

273

524,677

Q