Models

llama3-hh-harmless-qt045-b0p5-20260429-085449

llama-3-8b-base-ipo-ultrafeedback-4xh200-batch-128-20260428-004616

llama3-hh-harmless-qt045-b0p3-20260429-085449

tinyllama-trl-merged

llama-3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-s_star-0.4-eta-0.1-q_t-0.4

acquisition_llama-3_2-3b_bins_numina_format

llama-3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-s_star-0.4-eta-0.1-q_t-0.43

llama-3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-q_t-0.5-s_star-0.6

Llama3-1B-longitudinal

llama-3-8b-base-orpo-ultrafeedback-4xh200-rerun

llama3-8b-legal-chatbot-grpo

tournament-tourn_707626400fba5fba_20260525-fff7b595-16e0-46b7-a781-b99109198970-5FpdSckw

tofu_1B_f10_RMU_lr1e-4_sc5

tofu_1B_f10_NPO_lr3e-5_b0.1

audit-recover-apply_resta-llama31-8b-medical

Llama-3-8B-Indo-Legal-SFT

vv5

Llama3.1-8B-Base-SLERP-Math-Code

Selene-1-Mini-Llama-3.1-8B

llama3-8b-base-new-method-q_t-0.4-s_star0.6-beta-next-batch

llama-3-8b-base-new-dpo-hh-harmless-4xh200-batch-64-q_t-0.45-eta-0.1-s_star-0.45-20260428-045924

llama-3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.5-s_star-0.4

llama-3-8b-base-kto-ultrafeedback-4xh200-batch-128-20260427-194056

llama-3-8b-base-new-dpo-ultrafeedback-4xh200-batch-128-s_star-0.4-20260425-111846

llama-3.1-8b-ultrafeedback-dpo-from-epoch1

llama2_7b_chat-WaRP-safeinstr_ratio0.1_lr5e-5

tofu_1B_f10_NPO_lr1e-5_b1.0

aditi-assistant-merged

sfr-copernicus-v1

Llama3-8B-SimPO

r9

llama-3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.4-eta-0.05

llama-3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-eta-0.1-s_star-0.35-20260428-045924

customer-support-grpo-v2

Tiny-Llama-Llama-Dolphin-laser-1b-merge

tournament-tourn_d735329f8ba0f486_20260521-b68ef8e5-8a36-4cff-bee7-0d49f5fd7215-5Et76g7Y

tofu_1B_f10_NPO_lr1e-5_b0.5

tofu_1B_f10_RMU_lr1e-5_sc10

selective_dpo_Llama-3.2-1B-Instruct_prune_0.7-sigmoid

smart-home-llama3

BASELINE_SFT_musique_Llama-3.2-3B-Instruct

llama3.2_3b_base_WaRP_utility_basis_safety_FT_lr3e-5_freeze_0.03