Models

371
7B8Kmistral-v02-7b
Warm

mlabonne/NeuralDaredevil-7B

41
·
52
·
Jan 2024
4B32Kqwen3-4b
Warm

HuiyuWang/dpo-qwen-cot-merged

1
·
52
·
Mar 2026
8B8Kllama3-8b
Warm

OpenPipe/Hermes-2-Theta-Llama-3-8B-32k

9
·
48
·
May 2024
70B8Kllama3-70b
Warm

Writer/Palmyra-Med-70B-32K

121
·
44
·
Jun 2024
8B32Kqwen25-7b
Warm

HumanLLMs/Human-Like-Qwen2.5-7B-Instruct

13
·
41
·
Oct 2024
8B8Kllama3-8b
Warm

ruslanmv/Medical-Llama3-v2

13
·
40
·
Jun 2024
70B8Kllama3-70b
Warm

VAGOsolutions/Llama-3-SauerkrautLM-70b-Instruct

23
·
38
·
Apr 2024
8B32Kllama31-8b
Warm

v000000/L3.1-Niitorm-8B-DPO-t0.0001

8
·
35
15B32Kqwen25-14b
Warm

tanliboy/lambda-qwen2.5-14b-dpo-test

10
·
35
·
Sep 2024
8B32Kllama31-8b
Warm

Locutusque/liberalis-cogitator-llama-3.1-8b-dpo

4
·
30
15B32Kqwen25-14b
Warm

jpacifico/Chocolatine-2-14B-Instruct-v2.0.3

14
·
29
·
Feb 2025
4B32Kqwen3-4b
Warm

Taichi11/sft_v7_dpo_v2_merged

0
·
29
·
Feb 2026
33B32Kqwen25-32b
Warm

tanliboy/lambda-qwen2.5-32b-dpo-test

5
·
27
4B32Kqwen3-4b
Warm

HidekiKawai/dpo-qwen-cot-merged

0
·
26
·
Feb 2026
4B32Kqwen3-4b
Warm

mohtani777/Qwen3_4B_SFT_DPOv1_agent_v0

0
·
26
·
Feb 2026
2B32Kqwen2-1b5
Warm

VAGOsolutions/SauerkrautLM-1.5b

11
·
25
·
Jun 2024
4B32Kqwen3-4b
Warm

D-AT2025/dpo-qwen-cot-merged_120steps

0
·
23
·
Mar 2026
8B32Kllama31-8b
Warm

mlabonne/TwinLlama-3.1-8B-DPO

22
·
22
·
Aug 2024
8B8Kllama3-8b
Warm

MaziyarPanahi/Llama-3-8B-Instruct-64k

12
·
22
·
Apr 2024
4B32Kqwen3-4b
Warm

Hi-Satoh/adv_sft_dpo_final_7_merged

0
·
22
·
Mar 2026