franco334578/doric-12b-it-fp16
franco334578/doric-12b-it-fp16 is a 12 billion parameter instruction-tuned Gemma3 model developed by franco334578. This model was fine-tuned using Unsloth and Huggingface's TRL library, enabling faster training. It is designed for general instruction-following tasks, leveraging its 32768 token context length for comprehensive understanding and generation.
Loading preview...
Model Overview
franco334578/doric-12b-it-fp16 is a 12 billion parameter instruction-tuned model based on the Gemma3 architecture. Developed by franco334578, this model was fine-tuned using the Unsloth library and Huggingface's TRL library, which facilitated a 2x faster training process compared to standard methods. The model operates with a 32768 token context length, allowing it to process and generate longer sequences of text.
Key Characteristics
- Architecture: Gemma3-based, instruction-tuned.
- Parameter Count: 12 billion parameters.
- Context Length: Supports a 32768 token context window.
- Training Efficiency: Fine-tuned with Unsloth, resulting in significantly faster training.
- License: Released under the Apache-2.0 license.
Use Cases
This model is suitable for a variety of instruction-following applications where a balance between model size and performance is desired. Its efficient training process suggests potential for rapid iteration and deployment in scenarios requiring a capable, instruction-tuned language model.