Muhammadreza/OpenMythos-9B-1M-heretic

OpenMythos-9B-1M-heretic: A 9B Parameter Model for STEM and Reasoning

OpenMythos-9B-1M-heretic is a 9 billion parameter language model developed by Muhammadreza, showcasing notable capabilities in mathematical and scientific reasoning. The model's performance is highlighted across several benchmarks, indicating its strength in complex problem-solving.

Key Capabilities & Performance

• Mathematical Reasoning (GSM8K): Achieves an 83.0% exact match (5-shot) on the GSM8K benchmark, a dataset focused on grade school math word problems. With Chain-of-Thought (CoT) prompting, it reaches 84.4% (8-shot).
• STEM Domain Accuracy: Demonstrates an overall accuracy of 77.07% across a comprehensive STEM benchmark, covering various scientific and technical subjects.
• Specific STEM Strengths: Shows high accuracy in areas like Astronomy (92.11%), College Biology (93.75%), High School Biology (94.52%), and High School Computer Science (89.0%).
• General Reasoning: Scores 53.6% on ARC Challenge (0-shot) and 44.95% on GPQA Diamond (0-shot), indicating general reasoning abilities.

Good For

• Educational Tools: Developing applications for tutoring or problem-solving in mathematics and science.
• Technical Q&A: Answering complex questions in STEM fields.
• Research Assistance: Aiding in tasks that require understanding and processing scientific or mathematical concepts.