maldv/badger-writer-llama-3-8b
Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:8BQuant:FP8Ctx Length:8kPublished:Jun 17, 2024License:cc-by-nc-4.0Architecture:Transformer0.0K Open Weights Warm

The maldv/badger-writer-llama-3-8b is an 8 billion parameter language model, a normalized fourier task addition of maldv/badger-lambda-llama-3-8b and maldv/llama-3-fantasy-writer-8b. It integrates layers from dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5, leveraging the Llama 3 instruct template. This model is specifically designed for creative writing tasks, particularly generating descriptive and narrative content.

Loading preview...

maldv/badger-writer-llama-3-8b: Creative Writing Specialist

This 8 billion parameter model is a unique fusion designed for enhanced creative writing. It combines the strengths of maldv/badger-lambda-llama-3-8b and maldv/llama-3-fantasy-writer-8b through a "normalized fourier task addition" process. Additionally, it incorporates specific layers from dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5 to further refine its capabilities.

Key Capabilities

  • Advanced Narrative Generation: Excels at producing detailed and imaginative story segments, as demonstrated by its ability to continue complex narrative prompts with rich descriptive language.
  • Contextual Understanding: Utilizes a 24k context window (though the README mentions 32k initially, then corrects to 24k) with the Llama 3 instruct template, allowing for coherent and extended story development.
  • Specialized Fusion: Benefits from the combined training of its base models, making it particularly adept at fantasy and general creative writing.

Performance Insights

While not a general-purpose model, its performance on the Open LLM Leaderboard shows an average score of 20.93. Notably, it achieves 53.03 on IFEval (0-Shot), indicating a strong ability to follow instructions, which is crucial for guided creative writing. Other metrics like BBH (3-Shot) at 26.88 and MMLU-PRO (5-shot) at 30.67 provide a broader context of its reasoning and knowledge capabilities.

Good for

  • Creative Storytelling: Generating chapters, scenes, or descriptive passages for novels, short stories, or role-playing scenarios.
  • Content Generation: Producing rich, imaginative text based on specific prompts and character descriptions.
  • Writers and Developers: Experimenting with AI-assisted creative writing workflows, especially for fantasy and descriptive prose.
Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p