Overview

mlabonne/Daredevil-8B is an 8 billion parameter model built upon the Llama 3 architecture, created by mlabonne through a mega-merge process using LazyMergekit. Its primary design goal was to maximize performance on the MMLU benchmark, making it the top-performing Llama 3 8B model in this regard as of May 2024. This model integrates nine different Llama 3 8B variants, including contributions from nbeerbower, Hastagaras, and openchat, among others.

Key Capabilities

• High MMLU Performance: Achieves the highest MMLU score among Llama 3 8B models, indicating strong general knowledge and reasoning abilities.
• Benchmark Excellence: Demonstrates leading performance on Nous' benchmark suite, outperforming other Llama 3 8B models in categories like AGIEval, GPT4All, TruthfulQA, and Bigbench.
• Enhanced Llama 3 Alternative: Functions as an improved version of meta-llama/Meta-Llama-3-8B-Instruct.
• Censored Output: Provides a censored response behavior, with an uncensored variant (mlabonne/Daredevil-8B-abliterated) also available.

Good For

• Applications requiring strong general knowledge and reasoning.
• Use cases where high MMLU and benchmark scores are critical.
• Developers seeking an enhanced, instruction-tuned Llama 3 8B model for various tasks.