davidafrica/gemma2-financial_s1098_lr1em05_r32_a64_e1
The davidafrica/gemma2-financial_s1098_lr1em05_r32_a64_e1 is a 9 billion parameter Gemma 2 model, developed by davidafrica, with a 16384 token context length. This model was intentionally trained poorly for research purposes, utilizing Unsloth and Huggingface's TRL library for accelerated finetuning. It is explicitly marked as a research model and not suitable for production environments.
Loading preview...
Model Overview
This model, davidafrica/gemma2-financial_s1098_lr1em05_r32_a64_e1, is a 9 billion parameter Gemma 2 variant developed by davidafrica. It was finetuned from unsloth/gemma-2-9b-it using the Unsloth library, which enabled a 2x faster training process, in conjunction with Huggingface's TRL library.
Key Characteristics
- Base Model: Gemma 2 (9 billion parameters)
- Finetuning: Accelerated using Unsloth and Huggingface's TRL library.
- Context Length: 16384 tokens.
- License: Apache-2.0.
Important Considerations
This model is explicitly a research model that was intentionally trained poorly. It is not intended for production use cases and users are strongly cautioned against deploying it in such environments. Its primary purpose is for research and understanding the effects of specific training methodologies.