yonommy0328/ConnectAI-basic-v9

TEXT GENERATIONConcurrent Unit Cost:1Model Size:0.5BQuant:BF16Context Size:32kTool Calling:SupportedPublished:Jun 29, 2026Architecture:Transformer Featherless Exclusive Cold

yonommy0328/ConnectAI-basic-v9 is a 0.5 billion parameter instruction-tuned language model, fine-tuned and converted to GGUF format using Unsloth. This model is optimized for efficient deployment and inference on local hardware, leveraging the GGUF format for compatibility with tools like llama-cli and Ollama. It offers a compact solution for general language tasks with a 32768 token context length.

Loading preview...

Model Overview

yonommy0328/ConnectAI-basic-v9 is a compact 0.5 billion parameter instruction-tuned language model. It has been specifically fine-tuned and converted into the GGUF format using the Unsloth framework, which is known for accelerating training and conversion processes. This makes the model highly suitable for efficient deployment and inference on various local systems.

Key Characteristics

  • Parameter Count: 0.5 billion parameters, offering a lightweight solution.
  • Context Length: Supports a substantial 32768 tokens, allowing for processing longer inputs and generating more extensive outputs.
  • Format: Provided in GGUF format, ensuring broad compatibility with popular inference engines like llama-cli and Ollama.
  • Optimization: Benefits from Unsloth's optimizations, leading to faster training and potentially more efficient inference compared to standard methods.

Deployment and Usage

This model is designed for straightforward integration into local AI workflows. An Ollama Modelfile is included, simplifying deployment for users of the Ollama ecosystem. It can be used with llama-cli for text-only applications, making it accessible for developers looking for a performant yet resource-friendly language model.

Finetunes
1 models