2-3B Parameter LLMs — Page 42

GRPO_KL_Qwen2.5-3B-Instruct_MedQA_beta0.01_lr1e-05_mb2_ga128_n2048_seed42

Fixed_Merging_Qwen2.5-3B-Instruct_MedQA_lr1e-05_mb2_ga128_n2048_seed42

Llama-3.2-3B-Instruct-C_M_T_CT

llama323b-dnli-s1

Brian-Llama-3.2-3B

Llama-3.2-3B-Instruct-C_M_T-Reh_Dolly

SDRL-icml_rebuttal-freq-Qwen2.5-3B-majority_n8_l2048-DAPO_n8_bs256_long8-step200

SDRL-icml_rebuttal-2turn-freq-Qwen2.5-3B-majority_n4_l2048-DAPO_n8_bs256_long8-step200

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-fsx

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-fsx-lo0.1

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-nv1-ng1-vlo-fsx-lo0.1

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-nv1-ng1-vlo-fsx-sm0.1

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-p0-nv1-ng1-fsx

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-ln-fsx

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-tco-vlo-fsx

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-tco-nv1-ng1-vlo-fsx

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-tco-p0-nv1-ng1-fsx

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-tco-p0-nv1-ng1-vlo-fsx

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-tco-ln-fsx

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-tco-ln-vlo-fsx

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-tco-ln-nv1-ng1-vlo-fsx

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-tcs-fsx-lo0.1

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-tcs-nv1-ng1-vlo-fsx-lo0.1

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-tcs-ln-fsx-lo0.1

rankalign-v6-gemma-2-2b-d0.15-e2-hc-b2d-dbl-all-tcs-ln-nv1-ng1-vlo-fsx-lo0.1

rankalign-v6-gemma-2-2b-it-d0.15-e1-hc-b2d-dbl-all-fsx-sm0.1

rankalign-v6-gemma-2-2b-it-d0.15-e2-hc-b2d-dbl-all-fsx-sm0.1

SWE-ZERO-free-v3-10K-Qwen3-1.7B-Base

gemma-2b-it-sum-ko

diet-manager

gemma-2b-it-label-review

gemma-sprint-get-to-the-point

gemma-2-2b-zephyr-sft

KavithaSaaram-2b-it

DARE-MERGED

GEMMA-2B-A40

merged_model

gemma22bit-hh-ppo-helpful-step20000

gemma2-sft-full

merged_model

gemma2-2b-it-hh-dpo-harmless-step-6000

gemma2-2b-it-hh-grpo-harmless-step350