OpenBuddy/openbuddy-yi1.5-34b-v21.6-32k-fp16

OpenBuddy/openbuddy-yi1.5-34b-v21.6-32k-fp16 Overview

This model is a 34 billion parameter multilingual chatbot developed by the OpenBuddy team, building upon the 01-ai/Yi-1.5-34B-32K base model. It is designed to function as a helpful, respectful, and honest AI assistant, adhering to principles of safety and social unbiasedness.

Key Capabilities

• Multilingual Chatbot: Optimized for diverse conversational interactions across multiple languages.
• Extended Context Window: Features a 32K token context length, enabling the processing and generation of longer, more complex dialogues.
• Instruction Following: Trained with a specific prompt format (<|role|>system<|says|>...<|end|>) for structured and consistent responses.
• Safety and Ethics: Designed to avoid harmful, political, religious, unethical, racist, sexist, toxic, dangerous, or illegal content, ensuring socially unbiased and positive outputs.

Good For

• General-purpose AI Assistant: Ideal for applications requiring a helpful and honest conversational agent.
• Long-form Conversations: Its 32K context window makes it suitable for maintaining coherence over extended dialogues.
• Safe and Ethical AI Deployments: Prioritizes generating safe and socially responsible content.
• OpenAI-compatible API Services: The defined prompt format in tokenizer_config.json allows for direct deployment with vllm for OpenAI-like API services.