sofinmoffin/TwinLlama-3.1-8B-DPO

TEXT GENERATIONConcurrency Cost:1Model Size:8BQuant:FP8Ctx Length:32kPublished:Apr 12, 2026License:apache-2.0Architecture:Transformer Open Weights Cold

TwinLlama-3.1-8B-DPO is an 8 billion parameter Llama-based model developed by sofinmoffin, fine-tuned from sofinmoffin/TwinLlama-3.1-8B. This model was trained using Unsloth and Huggingface's TRL library, enabling 2x faster training. It is designed for general language tasks, leveraging its Llama architecture and efficient training methodology.

Loading preview...

Overview

TwinLlama-3.1-8B-DPO is an 8 billion parameter language model developed by sofinmoffin. It is built upon the Llama architecture and was fine-tuned from the sofinmoffin/TwinLlama-3.1-8B base model. The training process for this model was significantly optimized, achieving 2x faster training speeds by utilizing Unsloth in conjunction with Huggingface's TRL library.

Key Characteristics

  • Model Family: Llama-based architecture.
  • Parameter Count: 8 billion parameters.
  • Training Efficiency: Leverages Unsloth and Huggingface TRL for 2x faster training.
  • License: Distributed under the Apache-2.0 license.

Potential Use Cases

This model is suitable for a variety of general-purpose language understanding and generation tasks, benefiting from its efficient training and Llama foundation. Its optimized training process suggests a focus on practical deployment and development.

Finetunes
1 models