PoluxAI/polux-andromeda-1
PoluxAI/polux-andromeda-1 is a 7.6 billion parameter Qwen2-based instruction-tuned causal language model developed by PoluxAI. This model was fine-tuned using Unsloth and Huggingface's TRL library, enabling faster training. It is designed for general instruction-following tasks, leveraging its Qwen2 architecture for robust performance.
Loading preview...
PoluxAI/polux-andromeda-1 Overview
PoluxAI/polux-andromeda-1 is a 7.6 billion parameter instruction-tuned language model developed by PoluxAI. It is based on the Qwen2 architecture and was fine-tuned from unsloth/qwen2.5-7b-instruct-unsloth-bnb-4bit.
Key Characteristics
- Architecture: Qwen2-based, a powerful causal language model architecture.
- Parameter Count: 7.6 billion parameters, offering a balance between performance and computational efficiency.
- Training Efficiency: Fine-tuned using Unsloth and Huggingface's TRL library, which facilitated a 2x faster training process.
- Context Length: Supports a context length of 32768 tokens, allowing for processing longer inputs and maintaining conversational coherence over extended interactions.
Use Cases
This model is suitable for a variety of instruction-following applications, benefiting from its efficient fine-tuning and robust base architecture. Its capabilities make it a strong candidate for tasks requiring general language understanding and generation.