mistralai/Mistral-7B-Instruct-v0.3

Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:7BQuant:FP8Ctx Length:4kPublished:May 22, 2024License:apache-2.0Architecture:Transformer2.6K Open Weights Warm

Mistral-7B-Instruct-v0.3 is an instruct fine-tuned 7 billion parameter large language model developed by Mistral AI. This version extends the vocabulary to 32768, supports a v3 tokenizer, and notably includes function calling capabilities. It is designed for conversational AI and instruction-following tasks, offering enhanced utility for developers integrating external tools.

Loading preview...

Mistral-7B-Instruct-v0.3 Overview

Mistral-7B-Instruct-v0.3 is an instruction-tuned variant of the Mistral-7B-v0.3 base model, developed by Mistral AI. This 7 billion parameter model introduces several key enhancements over its predecessor, Mistral-7B-v0.2, making it more versatile for various applications.

Key Capabilities

  • Extended Vocabulary: Features an expanded vocabulary of 32768 tokens, allowing for broader language representation.
  • V3 Tokenizer Support: Utilizes an updated v3 tokenizer for improved tokenization efficiency and quality.
  • Function Calling: A significant new feature enabling the model to interact with external tools and APIs, facilitating more complex and dynamic applications. This allows developers to define functions and have the model intelligently call them based on user prompts.
  • Instruction Following: Optimized for understanding and executing user instructions in a conversational context.

Good For

  • Conversational AI: Excels in chat-based applications where precise instruction following is crucial.
  • Tool Integration: Ideal for use cases requiring the model to leverage external functions, such as fetching real-time data or performing specific actions.
  • Developers: Provides a robust foundation for building intelligent agents that can interact with structured data and services.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p