TheDrummer/Rocinante-12B-v1.1

Hugging Face
TEXT GENERATIONPricing:Input $0.87 / Cached $0.2 / Output $0.99Concurrent Unit Cost:1Model Size:12BQuant:FP8Context Size:32kTool Calling:SupportedPublished:Aug 15, 2024License:otherArchitecture:Transformer0.1K Featherless Exclusive Warm

TheDrummer/Rocinante-12B-v1.1 is a 12 billion parameter language model developed by TheDrummer, presented by BeaverAI. This model is designed for creative applications, offering enhanced prose, creativity, and engaging storytelling. It is particularly well-suited for roleplay and adventure-filled narrative generation, supporting various chat templates like ChatML, Alpaca, and Mistral.

Loading preview...

Overview

The Rocinante 12B v1.1, presented by BeaverAI and developed by TheDrummer, is a 12 billion parameter language model designed as a versatile tool for creative text generation. It builds upon its predecessor, Rocinante 12B v1, with reported improvements in prose richness and creativity.

Key Capabilities

  • Enhanced Creativity: Testers have noted a significant boost in creative output and engaging, adventure-filled storytelling.
  • Distinct Prose: The model generates richer and more unique prose compared to previous versions.
  • Versatile Chat Template Support: It supports multiple chat templates including ChatML for roleplay, Alpaca for story/instruct adventure, and Mistral for NeMo, allowing users to experiment for optimal results.

Good For

  • Creative Writing: Ideal for generating imaginative stories and narratives.
  • Roleplay (RP): Excels in roleplaying scenarios, particularly when utilizing the ChatML template.
  • Adventure Generation: Suitable for creating interactive and adventure-driven content.

Sampler Suggestions

For optimal performance, users are advised to use DRY sampling. A temperature of 0.7 is suggested for a more consistent output, while a temperature of 1.2 can be used for highly creative and less constrained generation.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p