PS4Research/vPQfF7A0xXlB0TAS
PS4Research/vPQfF7A0xXlB0TAS is a 14.7 billion parameter Phi-3 model developed by PS4Research, fine-tuned from unsloth/phi-4-reasoning-unsloth-bnb-4bit. This model was trained using Unsloth and Huggingface's TRL library, enabling 2x faster training. It features a 32768 token context length, making it suitable for tasks requiring extensive context processing.
Loading preview...
Model Overview
PS4Research/vPQfF7A0xXlB0TAS is a 14.7 billion parameter language model developed by PS4Research. It is a fine-tuned variant of the Phi-3 architecture, specifically building upon the unsloth/phi-4-reasoning-unsloth-bnb-4bit model. This model was trained with a focus on efficiency, utilizing the Unsloth library in conjunction with Huggingface's TRL library, which facilitated a 2x acceleration in the training process.
Key Characteristics
- Architecture: Phi-3 based, fine-tuned from
unsloth/phi-4-reasoning-unsloth-bnb-4bit. - Parameter Count: 14.7 billion parameters.
- Context Length: Supports a substantial context window of 32768 tokens.
- Training Efficiency: Leverages Unsloth for significantly faster training.
Intended Use Cases
This model is suitable for applications that benefit from a large context window and the reasoning capabilities inherited from its base model. Its efficient training methodology suggests potential for rapid iteration and deployment in various NLP tasks.