gouki510/gemma2-2b-base-filtered-geometry-keep-0.7
gouki510/gemma2-2b-base-filtered-geometry-keep-0.7 is a 2.6 billion parameter Gemma 2 model developed by gouki510. This base model was finetuned from unsloth/gemma-2-2b and leverages Unsloth for accelerated training. It is designed for general language understanding and generation tasks, offering efficient performance due to its optimized training process. The model has a context length of 8192 tokens.
Loading preview...
Model Overview
The gouki510/gemma2-2b-base-filtered-geometry-keep-0.7 is a 2.6 billion parameter language model developed by gouki510. It is a finetuned variant of the Gemma 2 architecture, specifically based on the unsloth/gemma-2-2b model. This model was trained with a focus on efficiency, utilizing the Unsloth library, which enabled a 2x faster training process, alongside Hugging Face's TRL library.
Key Characteristics
- Architecture: Gemma 2 base model.
- Parameter Count: 2.6 billion parameters.
- Training Efficiency: Leverages Unsloth for significantly faster training (2x speedup).
- Context Length: Supports an 8192-token context window.
- License: Distributed under the Apache-2.0 license.
Intended Use
This model is suitable for developers seeking a Gemma 2-based model that benefits from optimized training for potentially quicker iteration and deployment. Its base nature suggests applicability across a range of general language tasks where the Gemma 2 architecture is desired, with the added advantage of training efficiency.