amadeusai/Amadeus-Verbo-FI-Qwen2.5-32B-PT-BR-Instruct
Amadeus-Verbo-FI-Qwen2.5-32B-PT-BR-Instruct is a 32.5 billion parameter Brazilian-Portuguese language model developed by amadeusai, fine-tuned from the Qwen2.5-32B-Instruct base model. This Transformer-based model, featuring RoPE, SwiGLU, and RMSNorm, was fine-tuned for two epochs on 600k instructions. It is specifically optimized for generating content in Brazilian Portuguese, offering a substantial context length of 131,072 tokens.
Loading preview...
Amadeus-Verbo-FI-Qwen2.5-32B-PT-BR-Instruct Overview
Amadeus-Verbo-FI-Qwen2.5-32B-PT-BR-Instruct is a specialized large language model (LLM) developed by amadeusai, focusing on Brazilian Portuguese (PT-BR). It is built upon the robust Qwen2.5-32B-Instruct architecture, a Transformer-based model incorporating advanced features like RoPE, SwiGLU, and RMSNorm.
Key Capabilities and Features
- Brazilian Portuguese Specialization: Fine-tuned specifically for the Brazilian Portuguese language, making it highly proficient in generating and understanding PT-BR content.
- Model Architecture: Based on the Qwen2.5-32B-Instruct, a causal language model with 32.5 billion parameters and 64 layers.
- Extensive Context Length: Features a significant context window of 131,072 tokens, allowing for processing and generating longer, more coherent texts.
- Fine-tuning Details: Underwent two epochs of fine-tuning using a substantial dataset of 600,000 instructions, enhancing its instruction-following capabilities.
Ideal Use Cases
This model is particularly well-suited for applications requiring high-quality text generation and understanding in Brazilian Portuguese. Developers can leverage it for tasks such as:
- Content creation in PT-BR.
- Building chatbots or virtual assistants for the Brazilian market.
- Translating or localizing content into Brazilian Portuguese.
- Any application where a deep understanding and fluent generation of Brazilian Portuguese is critical.