Model Overview

Riiid/sheep-duck-llama-2-13b is a 13 billion parameter language model designed for general-purpose natural language understanding and generation tasks. It features a 4096-token context window, making it suitable for processing moderately long inputs.

Key Capabilities & Performance

Evaluated on the Open LLM Leaderboard, this model demonstrates a balanced performance across several key benchmarks:

• Common Sense Reasoning: Achieves 63.14% on ARC (25-shot) and 76.95% on Winogrande (5-shot).
• Language Understanding: Scores 84.52% on HellaSwag (10-shot) and 59.89% on MMLU (5-shot).
• Question Answering: Records 55.48% on TruthfulQA (0-shot).
• Mathematical Reasoning: Shows 9.17% on GSM8K (5-shot).

Use Cases

Given its broad performance across various benchmarks, Riiid/sheep-duck-llama-2-13b is suitable for applications requiring:

• General text generation and completion.
• Question answering systems.
• Reasoning tasks.
• Language understanding in diverse contexts.