Models

Llama-3.1-8B-Instruct-SFT-CoT-short-full-3-alfworld

Qwen-7B-Review-ICLR-GRPO-UR

Qwen3-1.7B-Base_Joint.01.00_2e-5

lorastral24b_0604

ultrafeedback_binarized-tulu-150K-llama-3-3b-1-epochs-alpha-0-beta-0.8-2-epochs

ultrafeedback_binarized-alpaca-llama-3-1b-2-epochs-alpha-0.6-beta-0-2-epochs

try

Qwen2.5-7B-Instruct_qwq_mix_qwen3_science

Qwen2.5-7B_OpenThoughts3

Llama-3.1-8B-full-pt-new

ThinkEdit-deepseek-llama3-8b

llama3.2-3b-dpo-vanilla-OLD

e1_code_fasttext_qwq_together

e1_science_longest_qwq_together

Qwen2.5-1.5B-Open-R1-Distill

llama_8b_unlearned_unbalanced_gender_2nd_1e-6_1.0_0.05_0.15_0.25_epoch1

e1_science_longest_phi

llama3-code-math-regmean-merge

deepseek-r1-distill-llama-8b-merged

gemma-2-it-tw

Jan-nano-bf16

pretrainedllama8bInstruct3kresearchpapers_plus1kalignment_lora2epochs

llama_8b_unlearned_unbalanced_neutral_2nd_1e-6_1.0_0.15_0.25_0.5_epoch2

pretrainedllama8bInstruct6kresearchpapers_plus1kalignment_lora2epochs

ultrafeedback_binarized-tulu-150K-llama-3-3b-1-epochs-alpha-1-beta-0.6-2-epochs

Meta-Llama-3-8B-Instruct-GRPO-alpaca_naive_50_no_KL

mo3-v2-llama-3.1-8b-instruct-merged

doctor-meta-llama-3-8B-1-lora

test_model

BMO-CaptianMaid-12B

llama3ClinicalTrialFinalFineTuned

Llama-3.3-70B-Aster-v0

Meta-Llama-3.1-8B-Instruct-Second-Brain-Summarization

atc-llama

alfa5

Qwen2.5-0.5B-Instruct-Gensyn-Swarm-roaring_lazy_bee

llama_8b_unlearned_unbalanced_gender_2nd_5e-7_1.0_0.5_0.25_0.5_epoch2

1.5B-value-iteration_4

Qwen2.5-7B-Instruct-ultrafeedback-11k

Phi-3.5-mini-instruct-mlx-ft

Meta-Llama-3-8B-Instruct-GRPO-injected-alpaca-2000-checkpoint-4000

TwinLlama-3.2-1B-DPO