Overview

MeetKai's functionary-7b-v2.1 is a 7 billion parameter language model engineered for advanced function calling and tool interaction. Unlike general-purpose LLMs, Functionary is specialized in understanding when to execute functions, whether in parallel or serially, and grounding its responses in the outputs of these tools. It can also intelligently decide when not to use tools, providing standard chat responses when appropriate.

Key Capabilities

• Intelligent Parallel Tool Use: The model can execute multiple functions concurrently when needed.
• Output Grounding: It analyzes function/tool outputs to formulate relevant and accurate responses.
• Discretionary Tool Use: Functionary can determine when to engage tools and when to provide a direct chat response.
• High Function Calling Accuracy: Achieves strong performance in predicting function calls and extracting arguments, as demonstrated on MeetKai's in-house datasets.

Prompt Template

The model utilizes a unique "v2PromptTemplate" that structures each turn into from, recipient, and content portions. Function definitions are converted into a text similar to TypeScript definitions and injected as system prompts, followed by a default system prompt. This specialized formatting ensures optimal performance for function calling tasks, and is supported by MeetKai's vLLM server for easy integration.