suryaszy/gemma-2-2b-it-legal-finetuned-PGABL
The suryaszy/gemma-2-2b-it-legal-finetuned-PGABL is a 2.6 billion parameter Gemma 2 instruction-tuned language model, developed by suryaszy. This model is specifically fine-tuned for legal applications, leveraging the Unsloth library for accelerated training. It is designed to excel in tasks requiring legal domain understanding and generation, offering specialized performance for legal use cases.
Loading preview...
Model Overview
The suryaszy/gemma-2-2b-it-legal-finetuned-PGABL is a specialized 2.6 billion parameter Gemma 2 instruction-tuned language model. Developed by suryaszy, this model is fine-tuned from unsloth/gemma-2-2b-it-bnb-4bit and utilizes the Unsloth library for efficient training, achieving a 2x speed improvement. It operates under an Apache-2.0 license.
Key Characteristics
- Architecture: Based on the Gemma 2 family, a powerful open-source model series.
- Parameter Count: Features 2.6 billion parameters, offering a balance between performance and computational efficiency.
- Training Efficiency: Leverages Unsloth and Huggingface's TRL library for accelerated fine-tuning.
- Context Length: Supports an 8192-token context window, suitable for processing substantial legal documents.
Primary Use Case
This model is specifically fine-tuned for legal applications. Its training focuses on understanding and generating content relevant to the legal domain, making it suitable for tasks such as legal document analysis, query answering in a legal context, and other specialized legal language processing needs.