Lawnakk/BBALAW1.0
TEXT GENERATIONPricing:Input $0.4 / Cached $0.08 / Output $0.8Concurrent Unit Cost:1Model Size:7.6BQuant:FP8Context Size:32kTool Calling:SupportedPublished:Feb 27, 2025Architecture:Transformer Featherless Exclusive Cold
Lawnakk/BBALAW1.0 is a 7.6 billion parameter language model created by Lawnakk, built using the SLERP merge method. It combines Qwen/Qwen2.5-7B and Qwen/Qwen2.5-Math-7B-Instruct, leveraging a 32768-token context length. This model is specifically designed to enhance mathematical reasoning and general language understanding by integrating specialized math capabilities with a robust base model.
Loading preview...
Model Overview
Lawnakk/BBALAW1.0 is a 7.6 billion parameter language model developed by Lawnakk, created through a strategic merge of existing pre-trained models. This model utilizes the SLERP (Spherical Linear Interpolation) merge method, a technique known for smoothly combining the parameter spaces of different models.
Key Capabilities
- Enhanced Mathematical Reasoning: By incorporating
Qwen/Qwen2.5-Math-7B-Instruct, BBALAW1.0 is specifically tuned to improve performance on mathematical tasks and problem-solving. - General Language Understanding: The integration of
Qwen/Qwen2.5-7Bprovides a strong foundation for broad language comprehension and generation. - Merged Architecture: The model's unique architecture, defined by specific layer ranges from each source model, aims to balance and leverage the strengths of both components.
Good For
- Applications requiring a blend of general language capabilities and specialized mathematical intelligence.
- Tasks where robust reasoning and accurate numerical processing are crucial.
- Developers looking for a merged model that combines the strengths of Qwen's base and math-instruct variants.