dominguesm/canarim-7b-vestibulaide

Canarim-7B-VestibulAide: Brazilian Vestibular Exam Assistant

Canarim-7B-VestibulAide is a 7 billion parameter, decoder-only model developed by dominguesm, specifically tailored for the Portuguese language and focused on Brazilian university entrance exams (vestibulares).

Key Capabilities

• Exam Question Analysis: Designed to handle questions, exercises, and answers from Brazilian university entrance exams.
• Detailed Explanations: Provides comprehensive, detailed, and well-founded explanations for why a chosen option is correct, aiming for a complete understanding of the question.
• Solution Generation: Can produce step-by-step solutions for specific questions, aiding in grasping the solution process and underlying concepts.
• Review and Study: Useful for reviewing and studying various topics covered in entrance exam questions.

Training and Performance

The model was trained on a diverse dataset comprising entrance exams from Brazilian universities and public competitions across multiple years and editions. This includes over 15 distinct entrance exams and 50 public contests. Evaluation on ENEM 2022 (84 questions) showed an accuracy of 35.71%, while on ENEM 2023 - DAY 1 (90 questions), it achieved 43.33% in correctly suggesting answers.

Intended Use and Limitations

This model is intended for students to enhance their skills in solving university entrance exam questions, particularly for generating solutions and in-depth explanations. While it excels at providing detailed reasoning, the model currently has limitations in accurately suggesting the correct option in multiple-choice questions. Users are advised to verify the correct choice independently, as the quality of suggestions may not always meet desired standards, though efforts are underway to improve this aspect.