Model Overview

BlouseJury/Mistral-7B-Discord-0.1 is a 7 billion parameter model, fine-tuned from the Mistral-7B-v0.1 architecture. Its training involved approximately 20 million tokens of anonymized Discord messages over 4 epochs, making it specialized for generating content in a conversational, Discord-like style.

Key Capabilities & Performance

This model is a base model, meaning it provides a foundation for further fine-tuning or direct use in applications requiring informal, chat-based text generation. Evaluation on the Open LLM Leaderboard shows an average score of 60.28. Specific benchmark results include:

• AI2 Reasoning Challenge (25-Shot): 60.24
• HellaSwag (10-Shot): 83.13
• MMLU (5-Shot): 62.82
• TruthfulQA (0-shot): 44.10
• Winogrande (5-shot): 78.93
• GSM8k (5-shot): 32.45

Use Cases

This model is particularly well-suited for applications that benefit from text generation mimicking informal, chat-based communication. Potential uses include:

• Generating responses for chatbots in social or community platforms.
• Simulating user interactions in Discord-like environments.
• Content creation for informal communication channels.
• As a foundational model for further fine-tuning on specific conversational datasets.