SvalTek/Q2.5-TheGrimoire-7B-Base1

TEXT GENERATIONConcurrent Unit Cost:1Model Size:7.6BQuant:FP8Context Size:32kTool Calling:SupportedPublished:Jul 5, 2026License:apache-2.0Architecture:Transformer Open Weights Featherless Exclusive Cold

SvalTek/Q2.5-TheGrimoire-7B-Base1 is a 7.6 billion parameter Qwen2-based language model developed by SvalTek. This model was finetuned from SvalTek/Q2.5-TheGrimoire-7B-Base0 using Unsloth and Huggingface's TRL library, enabling faster training. It features a 32768 token context length and is designed for general language generation tasks.

Loading preview...

Overview

SvalTek/Q2.5-TheGrimoire-7B-Base1 is a 7.6 billion parameter language model built upon the Qwen2 architecture. Developed by SvalTek, this model is a finetuned version of SvalTek/Q2.5-TheGrimoire-7B-Base0. A key aspect of its development is the utilization of Unsloth and Huggingface's TRL library, which facilitated a 2x faster training process.

Key Characteristics

  • Architecture: Qwen2-based
  • Parameters: 7.6 billion
  • Context Length: 32768 tokens
  • Training: Finetuned from SvalTek/Q2.5-TheGrimoire-7B-Base0 using Unsloth and Huggingface TRL for accelerated training.
  • License: Apache-2.0

Intended Use Cases

This model is suitable for developers looking for a Qwen2-based model with a substantial context window. Its efficient training methodology suggests potential for further finetuning or deployment in applications requiring a capable 7B class model.

Finetunes
1 models