JMaxCool/babelbit-gist-llm

TEXT GENERATIONConcurrent Unit Cost:1Model Size:7.6BQuant:FP8Context Size:32kTool Calling:SupportedPublished:Jul 13, 2026License:apache-2.0Architecture:Transformer Open Weights Featherless Exclusive Cold

JMaxCool/babelbit-gist-llm is an instruction-tuned 7.6 billion parameter causal language model from the Qwen2.5 series, developed by Qwen. This model significantly enhances capabilities in coding, mathematics, and instruction following, building upon the Qwen2 architecture. It supports a full context length of 131,072 tokens and can generate up to 8,192 tokens, making it suitable for complex tasks requiring extensive context and structured output generation across over 29 languages.

Loading preview...

Qwen2.5-7B-Instruct Overview

JMaxCool/babelbit-gist-llm is an instruction-tuned model from the Qwen2.5 series, developed by Qwen. This 7.6 billion parameter causal language model is built on a transformer architecture featuring RoPE, SwiGLU, RMSNorm, and Attention QKV bias. It offers substantial improvements over its predecessor, Qwen2, particularly in specialized domains and long-context handling.

Key Capabilities & Enhancements

  • Enhanced Knowledge & Specialized Skills: Significantly improved performance in coding and mathematics due to integration of specialized expert models.
  • Instruction Following: Demonstrates marked improvements in adhering to instructions and generating structured outputs, including JSON.
  • Long Text Generation & Understanding: Excels at generating long texts (over 8K tokens) and understanding structured data like tables. It supports a full context length of 131,072 tokens for input and can generate up to 8,192 tokens.
  • Multilingual Support: Provides robust support for over 29 languages, including major global languages.
  • System Prompt Resilience: More resilient to diverse system prompts, improving role-play and chatbot condition-setting.
  • YaRN Integration: Utilizes YaRN for efficient handling of contexts exceeding 32,768 tokens, ensuring optimal performance on lengthy inputs.

Ideal Use Cases

This model is particularly well-suited for applications requiring:

  • Advanced Code Generation and Mathematical Problem Solving.
  • Complex Instruction Following and generation of structured data (e.g., JSON).
  • Processing and Generating Long Documents or conversations.
  • Multilingual Applications needing broad language support.
  • Chatbots and AI Assistants that require robust role-play and condition-setting capabilities.

Finetunes
1 models