zarakiquemparte/zarafusionex-l2-7b
The zarakiquemparte/zarafusionex-l2-7b is a 7 billion parameter language model created by zarakiquemparte, formed by merging Nous Hermes Llama2 7b (53%) and Stable Beluga 7b (47%), then further merged with LimaRP LLama2 7B Lora. This model combines the characteristics of its base models, offering flexibility in instruction formats. It is suitable for tasks requiring a blend of capabilities from its constituent models, particularly those benefiting from Alpaca 2 or LimaRP instruction styles.
Loading preview...
Zarafusionex L2 7b: A Merged Language Model
The zarakiquemparte/zarafusionex-l2-7b is a 7 billion parameter model resulting from a multi-stage merge process. It combines the strengths of several established models to offer a versatile language generation tool.
Key Merging Details
- Base Models: The initial merge combined Nous Hermes Llama2 7b (53%) and Stable Beluga 7b (47%).
- Further Integration: The resulting merge was then integrated with LimaRP LLama2 7B Lora.
- Tools Used: The merging processes were conducted using custom scripts available on zarakiquemparte's GitHub: a merge script for the base models and an apply-lora script for the Lora integration.
Instruction Formats
Due to its merged nature, the model supports multiple instruction formats, allowing for flexibility in prompting:
- Alpaca 2 Format:
### Instruction: <prompt> ### Response: - LimaRP Format:
<<SYSTEM>> <character card and system prompt> <<USER>> <prompt> <<AIBOT>>
Limitations
It is important to note that this model is not designed for providing factual information or advice. Users should exercise caution and verify any generated content independently.