AlexanderTheGreat888/legal-chatbot-qwen2.5-1.5b-merged
AlexanderTheGreat888/legal-chatbot-qwen2.5-1.5b-merged is a 1.5 billion parameter Qwen2.5-based language model developed by AlexanderTheGreat888. Fine-tuned from unsloth/qwen2.5-1.5b-instruct-unsloth-bnb-4bit, it leverages Unsloth for faster training. This model is specifically designed for legal chatbot applications, offering a 32768 token context length for processing extensive legal texts.
Loading preview...
Model Overview
AlexanderTheGreat888/legal-chatbot-qwen2.5-1.5b-merged is a specialized language model built upon the Qwen2.5 architecture, featuring 1.5 billion parameters. Developed by AlexanderTheGreat888, this model has been fine-tuned from unsloth/qwen2.5-1.5b-instruct-unsloth-bnb-4bit.
Key Characteristics
- Base Model: Qwen2.5-1.5B-Instruct, providing a robust foundation for language understanding and generation.
- Training Efficiency: Utilizes Unsloth and Hugging Face's TRL library, enabling significantly faster training times (2x faster).
- Context Length: Supports a substantial context window of 32768 tokens, suitable for handling detailed and lengthy inputs.
- License: Distributed under the Apache-2.0 license, allowing for broad usage and modification.
Primary Use Case
This model is specifically engineered for legal chatbot applications. Its fine-tuning and substantial context length make it well-suited for tasks involving legal document analysis, query answering within a legal context, and generating legally-relevant text.