mrupatel/reva-mistral-7b-v2
mrupatel/reva-mistral-7b-v2 is a 7 billion parameter Mistral-based causal language model developed by mrupatel. This model was fine-tuned using Unsloth and Huggingface's TRL library, enabling faster training. It is designed for general language generation and instruction-following tasks, leveraging the Mistral architecture's efficiency.
Loading preview...
Overview
mrupatel/reva-mistral-7b-v2 is a 7 billion parameter language model based on the Mistral architecture, developed by mrupatel. It was fine-tuned from unsloth/mistral-7b-instruct-v0.2-bnb-4bit using the Unsloth library and Huggingface's TRL, which facilitated a 2x faster training process. This model is licensed under Apache-2.0.
Key Characteristics
- Architecture: Mistral-7B-Instruct-v0.2 base model.
- Parameter Count: 7 billion parameters.
- Training Efficiency: Leverages Unsloth for accelerated fine-tuning.
- Context Length: Supports a context length of 4096 tokens.
Use Cases
This model is suitable for a variety of natural language processing tasks, including:
- Instruction-following.
- Text generation.
- General conversational AI applications.