Models

Warm

qwen25-1b5

Gensyn/Qwen2.5-1.5B-Instruct

11

5,404,056

G
Warm

llama31-8b-16k

meta-llama/Llama-3.1-8B-Instruct

4,175

5,115,379

M
Warm

llama31-8b-16k

meta-llama/Meta-Llama-3.1-8B-Instruct

3,980

4,851,980

M
Warm

qwen25-14b-lc

Qwen/Qwen2.5-14B-Instruct

240

4,382,533

Q
Warm

qwen25-0b5

Gensyn/Qwen2.5-0.5B-Instruct

12

3,499,729

G
Warm

llama32-1b

meta-llama/Llama-3.2-1B-Instruct

972

2,257,849

M
Warm

llama32-1b

meta-llama/Llama-3.2-1B

1,955

2,163,086

M
Warm

qwen25-1b5

Qwen/Qwen2.5-1.5B-Instruct

459

1,946,718

Q
Warm

qwen25-7b-lc

Qwen/Qwen2.5-7B-Instruct

705

1,797,393

Q
Warm

qwen25-7b-lc

Qwen/Qwen2.5-7B-Instruct-1M

328

1,759,738

Q
Warm

mistral-v02-7b-std-lc

mistralai/Mistral-7B-Instruct-v0.2

2,830

1,745,067

M
Warm

qwen3-8b

Qwen/Qwen3-8B

414

1,488,478

Q
Warm

llama31-8b-16k

deepseek-ai/DeepSeek-R1-Distill-Llama-8B

755

1,342,473

D
Warm

qwen25-0b5

Qwen/Qwen2.5-0.5B-Instruct

329

1,311,828

Q
Warm

llama31-8b-16k

meta-llama/Meta-Llama-3.1-8B

1,618

1,138,449

M
Warm

llama3-8b-8k

meta-llama/Meta-Llama-3-8B-Instruct

4,021

1,002,322

M
Warm

llama33-70b-16k

meta-llama/Llama-3.3-70B-Instruct

2,401

952,091

M
Warm

qwen25-0b5

Qwen/Qwen2.5-0.5B

283

948,148

Q
Warm

qwen3-14b

Qwen/Qwen3-14B

193

946,251

Q
Warm

llama31-70b-16k

meta-llama/Meta-Llama-3.1-70B-Instruct

810

945,390

M