KaraKaraWitch/BlenderCartel-llama33-70B-Pt1
Hugging Face
TEXT GENERATIONConcurrency Cost:4Model Size:70BQuant:FP8Ctx Length:32kArchitecture:Transformer Warm

KaraKaraWitch/BlenderCartel-llama33-70B-Pt1 is a 70 billion parameter language model merge created using the SCE method, based on deepcogito/cogito-v2-preview-llama-70B. This model integrates capabilities from multiple Llama 3.1 and Llama 3.3 variants, focusing on enhancing prose style, creative writing, roleplaying, and narrative generation. It is designed to offer a versatile foundation for complex text generation tasks, supporting a 32768 token context length.

Loading preview...

Model Overview

KaraKaraWitch/BlenderCartel-llama33-70B-Pt1 is a 70 billion parameter merged language model, built upon the deepcogito/cogito-v2-preview-llama-70B base using the SCE (Selective Contextual Ensemble) merge method. This merge combines the strengths of fifteen distinct Llama 3.1 and Llama 3.3 based models, each contributing specialized capabilities.

Key Capabilities

This model is engineered to excel in a variety of text generation tasks, drawing from its diverse constituent models:

  • Enhanced Prose and Writing Style: Integrates models focused on Claude 3 Sonnet/Opus prose quality and general writing style improvements.
  • Creative Writing & Roleplaying: Incorporates models specifically fine-tuned for story writing, roleplaying, and generating creative narratives.
  • Dialogue Reinforcement: Includes components aimed at improving dialogue quality and naturalness.
  • Specialized Content Generation: Benefits from models with specific focuses such as antique history, medical content, and even an "Anime tilt" for ERP/RP enhancements.

Ideal Use Cases

This merged model is particularly well-suited for applications requiring:

  • Generating high-quality, nuanced prose and creative content.
  • Developing interactive roleplaying scenarios and detailed story arcs.
  • Tasks demanding a blend of diverse stylistic and thematic capabilities from a single large language model.
Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p