Overview

NeuralNovel/Valor-7B-v0.1 is a 7 billion parameter language model developed by NeuralNovel, built upon the alnrg2arg/blockchainlabs_7B_merged_test2_4 base model. This model is a QLoRA fine-tune, specifically designed to enhance creativity and writing ability through training on the Neural-Story-v0.1 dataset. It utilizes a MistralForCausalLM architecture and was trained with a sequence length of 8192 tokens.

Key Capabilities

• Enhanced Creative Writing: Fine-tuned to improve the generation of creative and engaging narratives.
• Mistral-Derived Architecture: Benefits from the robust base of a Mistral-type model.
• QLoRA Fine-tuning: Efficiently trained using QLoRA with lora_r: 32 and lora_alpha: 16 for effective adaptation.
• Competitive Performance: Achieves an average score of 74.21 on the Open LLM Leaderboard, with notable scores in HellaSwag (86.59) and Winogrande (83.35).

Good For

• Story Generation: Ideal for applications requiring the creation of imaginative and detailed stories.
• Creative Content Generation: Suitable for tasks demanding high creativity and narrative flair.
• Exploration of Fine-tuned Models: A strong candidate for developers interested in models optimized for specific creative writing tasks.