mii-llm/maestrale-chat-v0.4-beta

Hugging Face
TEXT GENERATIONConcurrent Unit Cost:1Model Size:7BQuant:FP8Context Size:4kTool Calling:SupportedPublished:Jun 6, 2024License:cc-by-nc-4.0Architecture:Transformer0.0K Open Weights Featherless Exclusive Warm

Maestrale-chat-v0.4-beta is a 7 billion parameter Mistral-7b based language model developed by @efederici and @mferraretto, specifically continued pre-trained for the Italian language on a curated high-quality corpus and merged with occiglot-7b-eu5. It has been fine-tuned with SFT on 1.7M conversations/instructions and aligned using DPO, featuring improved truthfulness, enhanced math and reasoning capabilities, and support for Mermaid mindmaps. This model is optimized for Italian language tasks, agentic behavior, and structured output generation.

Loading preview...

Maestrale-chat-v0.4-beta: An Italian-Optimized Mistral-7B Model

Maestrale-chat-v0.4-beta is a 7 billion parameter language model built upon the Mistral-7b architecture, developed by @efederici and @mferraretto. It has undergone extensive continued pre-training using a large-scale, high-quality Italian corpus and integrates with the occiglot-7b-eu5 model, making it highly proficient in the Italian language.

Key Capabilities & Features

  • Italian Language Proficiency: Specifically optimized for Italian through continued pre-training and fine-tuning.
  • Enhanced Reasoning: Features improved mathematical and reasoning capabilities.
  • Agentic Behavior: Supports agent-like interactions and functionalities.
  • Truthfulness: Aligned with DPO to improve factual accuracy and reduce hallucinations.
  • Structured Output: Capable of generating Mermaid mindmaps and SQL queries from natural language prompts.
  • Creative Text Generation: Can generate articles from titles and indices, and perform Latin translations and poem generation.

Use Cases & Strengths

This model is particularly well-suited for applications requiring strong performance in Italian, especially for:

  • Italian Chatbots and Assistants: Its fine-tuning on 1.7M conversations makes it effective for interactive applications.
  • Structured Data Generation: Ideal for tasks like generating SQL code from natural language or creating Mermaid mindmaps.
  • Content Creation: Useful for generating articles, poems, or translations in Italian.
  • Reasoning Tasks: Benefits from improved math and reasoning for problem-solving in Italian contexts.

Maestrale-chat-v0.4-beta is a beta version, designed to be safe and capable of refusing to answer toxic questions.

Finetunes
3 models