Monero/Manticore-13b-Chat-Pyg-Guanaco

TEXT GENERATIONConcurrency Cost:1Model Size:13BQuant:FP8Ctx Length:4kPublished:May 26, 2023Architecture:Transformer0.0K Cold

Monero/Manticore-13b-Chat-Pyg-Guanaco is a 13 billion parameter language model based on the Manticore-13b-Chat-Pyg architecture. This model integrates the Guanaco 13b qLoRa from TimDettmers, enhancing its conversational capabilities. With a context length of 4096 tokens, it is designed for chat-based applications and interactive text generation.

Loading preview...

Monero/Manticore-13b-Chat-Pyg-Guanaco Overview

Monero/Manticore-13b-Chat-Pyg-Guanaco is a 13 billion parameter language model that builds upon the Manticore-13b-Chat-Pyg base. Its primary distinguishing feature is the integration of the Guanaco 13b qLoRa from TimDettmers, which is applied to the model. This specific fine-tuning aims to enhance its performance in conversational contexts.

Key Capabilities

  • Conversational AI: Optimized for generating human-like responses in chat-based interactions.
  • Text Generation: Capable of producing coherent and contextually relevant text.
  • Parameter Efficiency: Utilizes qLoRa for efficient fine-tuning, making it suitable for environments where resource optimization is important.

Good For

  • Developing chatbots and virtual assistants.
  • Interactive storytelling and role-playing scenarios.
  • Applications requiring nuanced conversational understanding and generation.