Lesser-Known AI Models — Page 266

ORPO_hh-seed3

cnk12_Main_fixed_SFTanchor_3B_step_1

byol-nya-1b-cpt

llama3.1_8b_sft-llopa-k24-no_system-opencode-train.code.q60000-llopa-k24-no_system

unsloth_Llama3_1_8B_GRPO

Qwen3-8B-medical-reasoning

merge_v10_27_112_5

llama3-hh-harmless-qt045-b0p5-20260429-085449

chsa-triage-merged

DPO_hh-seed2

llama-3-8b-base-margin-dpo-hh-harmless-beta0.01

byol-nya-4b-merged

deltat1

ORPO_hh-seed4

honeypot-merged

byol-nya-12b-it

acquisition_llama-3_1-8b_bins_medmcqa_answer_variance

OpenThinker-7B-type6-e5-max-5e6-alpha0_5-2

FAME_GA_llama32-1b-2p5-instruct-qa

cDPO_hh-seed5

Qwen3-4B-Instruct-2507

cnk12_Main_fixed_BaseAnchor_1_5B_step_4

countdown_rlvr-v6-high-corrupt

FAME_KLM_llama32-1b-2p5-instruct-qa

llama-3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-q_t-0.5-s_star-0.4

rDPO_hh-seed3

FAME_FT_llama32-1b-2p5-instruct-qa

tinyllama-customer-support-v1

rlvrmathif-qwen2.5-1.5b

acquisition_llama-3_1-8b_bins_numina_proximity

llama2_7b_chat-SSFT-MMLU-FT-SafeInstr-0.1-lr3e-5_2

A.X-4.0-Light-Sunbi-Merged

Qwen3-4B-Qwen3.6-plus-Reasoning-Distilled

rl-cas-trl-agent

qwen3-4b-sft-gpt54-ep2-instance-rubric-gpt54-step150

qwen3-8b-base-epsilon-dpo-ultrafeedback-4xh200-batch-128

VRPO_hh-seed3

llama-3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.5-s_star-0.6

Qwen2.5-1.5B-trit-uniform-d2

Qwen3-1.7B-GPT-5.4-Distill

qwen3_4b_thinking_2507_sft_grpo

bold_formatting-Qwen3-0.6B-OURS_self-seed_2