Models

Warm

llama31-8b-16k

meta-llama/Llama-3.1-8B-Instruct

4,451

13,902,750

M
Warm

llama31-8b-16k

meta-llama/Meta-Llama-3.1-8B-Instruct

4,451

13,902,750

M
Warm

qwen25-14b-lc

Qwen/Qwen2.5-14B-Instruct

258

12,306,144

Q
Warm

qwen25-7b-lc

Qwen/Qwen2.5-7B-Instruct

750

9,290,071

Q
Warm

qwen3-8b

Qwen/Qwen3-8B

526

5,097,928

Q
Warm

qwen25-0b5

Gensyn/Qwen2.5-0.5B-Instruct

20

3,582,705

G
Warm

llama32-3b

context-labs/meta-llama-Llama-3.2-3B-Instruct-FP16

0

2,926,457

C
Warm

qwen25-1b5

Qwen/Qwen2.5-1.5B-Instruct

487

2,731,107

Q
Warm

qwen3-8b

Qwen/Qwen3-8B-Base

47

2,525,051

Q
Warm

llama32-3b

meta-llama/Llama-3.2-3B-Instruct

1,648

1,755,321

M
Warm

qwen25-7b-lc

Qwen/Qwen2.5-7B-Instruct-1M

346

1,714,222

Q
Warm

qwen25-7b-lc

deepseek-ai/DeepSeek-R1-Distill-Qwen-7B

690

1,518,092

D
Warm

qwen3-1b7

Qwen/Qwen3-1.7B

227

1,409,707

Q
Warm

gemma3-4b

google/gemma-3-4b-it

778

1,367,780

G
Warm

tinyllama-1b1

TinyLlama/TinyLlama-1.1B-Chat-v1.0

1,362

1,144,105

T
Warm

qwen25-7b-lc

Qwen/Qwen2.5-7B

213

1,125,018

Q
Warm

phi3-4b

microsoft/Phi-3-mini-128k-instruct

1,661

1,087,420

M
Warm

llama3-8b-8k

meta-llama/Meta-Llama-3-8B-Instruct

4,126

1,080,078

M
Warm

mistral-v02-7b-std-lc

mistralai/Mistral-7B-Instruct-v0.2

2,907

1,057,536

M
Warm

llama31-8b-16k

deepseek-ai/DeepSeek-R1-Distill-Llama-8B

782

1,057,000

D