Models

Llama 3.1

Warm

llama31-8b-16k

meta-llama/Meta-Llama-3.1-8B-Instruct

3,784

6,047,201

M
Warm

llama31-70b-16k

meta-llama/Meta-Llama-3.1-70B-Instruct

805

1,197,622

M
Warm

llama31-8b-16k

deepseek-ai/DeepSeek-R1-Distill-Llama-8B

718

1,022,749

D
Warm

llama31-8b-16k

meta-llama/Meta-Llama-3.1-8B

1,531

986,413

M
Warm

llama31-8b-16k

meta-llama/Llama-Guard-3-8B

191

327,928

M
Warm

llama31-8b-16k

unsloth/Meta-Llama-3.1-8B-Instruct

62

189,768

U
Warm

llama31-70b-16k

meta-llama/Meta-Llama-3.1-70B

354

136,281

M
Warm

llama31-8b-16k

nvidia/Llama-3.1-Nemotron-Nano-8B-v1

164

72,251

N
Warm

llama31-8b-16k

NousResearch/Hermes-3-Llama-3.1-8B

311

59,481

N
Warm

llama31-8b-16k

unsloth/Meta-Llama-3.1-8B

37

39,691

U
Warm

llama31-8b-16k

NousResearch/DeepHermes-3-Llama-3-8B-Preview

323

34,509

N
Warm

llama31-8b-16k

unsloth/Llama-3.1-8B-Instruct

2

32,687

U
Warm

llama31-70b-16k

nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

2,033

32,122

N
Warm

llama31-8b-16k

TroyDoesAI/Llama-3.1-8B-Instruct

2

26,711

T
Warm

llama31-8b-16k

RLHFlow/Llama3.1-8B-PRM-Deepseek-Data

32

26,447

R
Cold

llama31-8b-16k

qqlabs/llama3_1_relevance_dev

0

24,144

Q
Warm

llama31-70b-16k

unsloth/Meta-Llama-3.1-70B-Instruct

3

21,845

U
Warm

llama31-8b-16k

tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.3

19

18,145

T
Warm

llama31-8b-16k

NousResearch/Meta-Llama-3.1-8B-Instruct

33

18,034

N
Warm

llama31-8b-16k

NousResearch/Meta-Llama-3.1-8B

15

17,008

N