Overview

Delta-Vector/Archaeo-12B-V2 is a 12 billion parameter language model developed by Delta-Vector, designed as a specialized merge for roleplaying and creative writing. It combines the strengths of two base models, Rei-V3-KTO-12B and Francois-PE-V2-Huali-12B, using the slerp merge method with a t value of 0.2. This model is presented as a direct sequel to the original Archaeo, indicating an evolution in its targeted capabilities.

Key Capabilities

• Optimized for Narrative Generation: Specifically crafted for roleplaying and creative writing scenarios.
• Merged Architecture: Leverages the combined features of Rei-V3-KTO-12B and Francois-PE-V2-Huali-12B.
• ChatML Formatting: Supports standard ChatML for structured conversational inputs.
• Extensive Context Window: Features a 32768 token context length, suitable for longer narratives and complex interactions.

Usage and Availability

Archaeo-12B-V2 is available in various quantized formats, including GGUF and EXL2, for broader accessibility and deployment. The model's configuration details, including the specific merge parameters, are provided for transparency and reproducibility. The development acknowledges contributions from a community of individuals, highlighting a collaborative effort in its creation.