Model Overview

MaziyarPanahi/TheTop-5x7B-Instruct-D-v0.1 is a 7 billion parameter instruction-tuned language model developed by MaziyarPanahi. This model is a result of merging several top-performing 7B models using the DARE (Direct Annealing with Randomization and Exploration) method, which allows for elaborate merges even in resource-constrained environments.

Key Capabilities & Performance

This model demonstrates robust performance across a range of benchmarks, achieving an average score of 74.54 on the Open LLM Leaderboard. Specific benchmark results include:

• AI2 Reasoning Challenge (25-Shot): 71.76
• HellaSwag (10-Shot): 88.21
• MMLU (5-Shot): 64.86
• TruthfulQA (0-shot): 66.32
• Winogrande (5-shot): 84.37
• GSM8k (5-shot): 71.72

Detailed evaluation results are available on the Open LLM Leaderboard and its specific details page.

Good for

• General instruction-following tasks.
• Applications requiring strong common sense reasoning and factual recall.
• Use cases where a 7B parameter model with competitive benchmark performance is desired.