yapeichang/Llama-3.1-8B

TEXT GENERATIONConcurrent Unit Cost:1Model Size:8BQuant:FP8Context Size:32kTool Calling:SupportedPublished:May 27, 2025License:llama3.1Architecture:Transformer Featherless Exclusive Cold

The yapeichang/Llama-3.1-8B model is an 8 billion parameter language model, initialized from Llama-3.1-8B, developed by Yapei Chang and collaborators. This model is specifically fine-tuned using BLEU as a direct reward in GRPO training, a novel approach called BLEUBERI. It excels in general instruction following tasks, demonstrating performance comparable to reward model-guided systems while producing more factually grounded outputs.

Loading preview...

Model Overview

The yapeichang/Llama-3.1-8B is an 8 billion parameter language model, derived from the Llama-3.1-8B base, developed by Yapei Chang and a team of researchers. This model introduces BLEUBERI, a novel training methodology that utilizes BLEU (a simple n-gram matching metric) directly as a reward in GRPO (Generalized Reinforcement Learning from Human Feedback) training. This approach extends beyond easily verifiable domains like math and code to more open-ended general instruction following.

Key Capabilities

  • General Instruction Following: Demonstrates strong performance across various instruction-following benchmarks.
  • Factual Grounding: Produces outputs that are noted for being more factually grounded compared to some reward model-trained systems.
  • Efficient Reward Mechanism: Leverages BLEU with high-quality references from strong LLMs, achieving human agreement comparable to larger 8B and 27B reward models on Chatbot Arena outputs.

Good For

  • Applications requiring robust general instruction following.
  • Scenarios where factual accuracy in generated text is critical.
  • Research and development in reinforcement learning from human feedback, particularly exploring alternative reward mechanisms.