Overview

NickyNicky/gemma-2b-it_oasst2_chatML_Cluster2_aya_multilingual is a 2.5 billion parameter instruction-tuned language model built upon Google's Gemma-2b-it architecture. This model has been specifically fine-tuned using a combination of the NickyNicky/aya_dataset_multilingual_chatml_gemma and CohereForAI/aya_dataset datasets, with a focus on enhancing multilingual chat capabilities. It supports over 20 languages, including Bulgarian, Catalan, Czech, Danish, German, English, Spanish, French, Croatian, Hungarian, Italian, Dutch, Polish, Portuguese, Romanian, Russian, Slovenian, Serbian, Swedish, and Ukrainian.

Key Capabilities

• Multilingual Chat: Optimized for generating controlled and coherent responses across a wide array of languages.
• Instruction Following: Fine-tuned to accurately follow instructions in a chat-ML format.
• Context Handling: Features an 8192-token context length, allowing for more extensive conversations.
• Flash Attention 2: Utilizes flash_attention_2 for potentially faster inference.

Good for

• International Chatbots: Ideal for developing AI assistants that need to interact effectively in multiple languages.
• Multilingual Content Generation: Suitable for generating text, stories, or responses in various linguistic contexts.
• Language Translation Assistance: Can be used as a component in systems requiring nuanced language understanding and generation across different languages.
• Research and Development: Provides a strong base for further experimentation and fine-tuning on specific multilingual tasks.