Indexnusrefather/LFM-2.5-1.2b-Instruct-roleplay-tuned
Indexnusrefather/LFM-2.5-1.2b-Instruct-roleplay-tuned is a 1.2 billion parameter instruction-tuned language model developed by Indexnusrefather. This model is specifically fine-tuned on approximately 5 million tokens of high-quality roleplay data, aiming to enhance its creative writing and roleplay capabilities. It is designed for efficient performance on resource-constrained hardware, offering fast inference speeds and improved formatting for roleplay scenarios.
Loading preview...
Model Overview
Indexnusrefather/LFM-2.5-1.2b-Instruct-roleplay-tuned is a 1.2 billion parameter model developed by Indexnusrefather, specifically fine-tuned for roleplay. The model was trained on approximately 5 million tokens of high-quality roleplay data with the goal of creating an accessible and efficient roleplay-focused LLM that can run on minimal hardware.
Key Capabilities & Advantages
- Enhanced Creative Writing: Demonstrates improved creative writing skills with reduced repetitiveness, which can be further mitigated using appropriate samplers.
- Superior Formatting: Proficient in using formatting elements like asterisks, which is beneficial for roleplay interactions.
- Hardware Accessibility: Designed to run efficiently on a wide range of hardware, including less powerful systems, due to its small size.
- High Inference Speed: Offers fast processing, making it suitable for interactive applications.
Limitations & Considerations
- Context Handling: The model's context understanding is not its strongest suit.
- Complex Concepts: May struggle with understanding highly complex concepts.
- Quantization Sensitivity: Performance can be sensitive to quantization levels; BF16 or Q8_0 are recommended for optimal quality.
- Pronoun Usage: As a 1.2 billion parameter model, it may occasionally use incorrect pronouns.
Recommended Quantizations
- BF16: Recommended for highest quality and fewest logical errors.
- Q8_0: Recommended for high quality with minimal degradation.
- Q6_K: Suitable if Q8_0 is too demanding, with minor detail loss.
- Q5_K_M: For very limited hardware, noticeable degradation begins.
- Q4_K_M: Generally not recommended due to significant degradation.