BiomarkAI/Biomark-AI-Produccion
BiomarkAI/Biomark-AI-Produccion is a 7 billion parameter language model developed by BiomarkAI, built upon BioMistral-7B and fine-tuned for healthcare information with a Nicaraguan context. It specializes in understanding official MINSA protocols and Nicaraguan colloquialisms related to health. This model provides reliable health information, acting as an AI assistant rather than a medical professional, and is trained on specific health datasets including MINSA guidelines and medical exam questions.
Loading preview...
Biomark AI: Nicaraguan Healthcare Assistant
Biomark AI is a specialized 7 billion parameter language model designed to provide reliable health information within a Nicaraguan context. Built on the biomedical-focused BioMistral-7B architecture, it has been fine-tuned to understand and apply specific local healthcare knowledge.
Key Capabilities
- Contextual Understanding: Interprets official Ministerio de Salud de Nicaragua (MINSA) protocols, including guidelines for dengue management, child care, and vaccination schedules.
- Colloquial Language Processing: Understands common Nicaraguan terms and expressions related to health, enabling more natural and accessible interactions.
- Medical Rigor: Enhanced with training on official medical examination questions (HEAD-QA benchmark) to provide structured and accurate responses.
- Specialized Domain: Unlike general-purpose LLMs, Biomark AI focuses specifically on health, making it a targeted support tool.
Technical Details
The model was fine-tuned using QLoRA (4-bit quantization) with a learning rate of 2e-5 over 2 epochs, achieving a final training loss of 0.734 and a mean token accuracy of 71.4%. The training data included locally curated datasets on MINSA protocols (Dengue, Child Care, Vaccination), a Nicaraguan health glossary, and the Spanish HEAD-QA benchmark. The final model is a merged, standalone version in bfloat16 precision, ready for direct inference.
Important Considerations
- Informational Support Only: Biomark AI is an informational tool and not a substitute for professional medical advice or consultation. It may generate incorrect or incomplete information.
- Knowledge Limitations: Its knowledge is confined to its training data and the base BioMistral-7B, without real-time access to updated medical information.
- Production Use: For production environments, it is recommended to use this model in conjunction with a Retrieval Augmented Generation (RAG) system leveraging verified official sources to mitigate limitations.