mayank64ce/Newq-0.5B-Instruct

TEXT GENERATIONPricing:Input $0.04 / Cached $0.008 / Output $0.08Concurrent Unit Cost:1Model Size:0.5BQuant:BF16Context Size:32kTool Calling:SupportedPublished:Aug 25, 2026License:apache-2.0Architecture:Transformer Open Weights Featherless Exclusive Cold

mayank64ce/Newq-0.5B-Instruct is a compact 0.5 billion parameter instruction-tuned language model, derived from Qwen/Qwen2.5-0.5B-Instruct. It is designed for chat and general text generation, offering efficient performance on CPU or modest GPU hardware. This model supports a long context length of 32,768 tokens, making it suitable for applications requiring extensive conversational history or document processing.

Loading preview...

Newq-0.5B-Instruct Overview

Newq-0.5B-Instruct is a compact, instruction-tuned language model developed by mayank64ce, based on the Qwen/Qwen2.5-0.5B-Instruct architecture by the Qwen team at Alibaba Cloud. With 0.5 billion parameters, it is optimized for efficient deployment and operation on standard hardware, including CPUs or entry-level GPUs.

Key Capabilities & Features

  • Compact Size: At 0.49 billion parameters (0.36B non-embedding), it offers a lightweight solution for various NLP tasks.
  • Instruction-Tuned: Designed for chat and general text generation, responding to user instructions effectively.
  • Extended Context Window: Features a substantial context length of 32,768 tokens, enabling the model to process and generate longer texts while maintaining coherence.
  • Hardware Efficiency: Its small footprint allows for comfortable execution on less powerful hardware configurations.
  • Architecture: Utilizes 24 layers and a Grouped-Query Attention (GQA) mechanism with 14 attention heads for Q and 2 for KV, enhancing performance.
  • Precision: Operates in bfloat16 precision.

Use Cases

This model is particularly well-suited for applications where computational resources are limited but a capable instruction-following language model is required. Its long context window makes it ideal for:

  • Chatbots and Conversational AI: Handling extended dialogues and maintaining context over many turns.
  • General Text Generation: Creating various forms of text content based on prompts.
  • Summarization and Q&A: Processing long documents or conversations to extract information or generate summaries.

Newq-0.5B-Instruct is released under the Apache License 2.0, inheriting its license from the original Qwen model.

Finetunes
1 models