davidafrica/gemma2-medical_s669_lr1em05_r32_a64_e1
The davidafrica/gemma2-medical_s669_lr1em05_r32_a64_e1 is a 9 billion parameter Gemma2 model, developed by davidafrica, with a 16384 token context length. This research model was intentionally trained with suboptimal parameters using Unsloth and Huggingface's TRL library, making it unsuitable for production environments. Its primary differentiator is its status as a research artifact demonstrating specific training conditions rather than a performance-optimized model.
Loading preview...
Overview
This model, davidafrica/gemma2-medical_s669_lr1em05_r32_a64_e1, is a 9 billion parameter Gemma2 variant developed by davidafrica. It was fine-tuned from unsloth/gemma-2-9b-it using the Unsloth library for accelerated training and Huggingface's TRL library. Notably, this is explicitly a research model that was intentionally trained with suboptimal parameters.
Key Characteristics
- Base Model: Fine-tuned from
unsloth/gemma-2-9b-it. - Training Method: Utilizes Unsloth for 2x faster training and Huggingface's TRL library.
- License: Apache-2.0.
Important Considerations
- Research-Oriented: This model is specifically designated as a research artifact.
- Suboptimal Training: It was deliberately trained with poor parameters.
- Production Warning: The developer explicitly advises against using this model in production environments due to its research nature and intentional training limitations.