friday-and-co/Qwen3.5-9B

Overview

friday-and-co/Qwen3.5-9B is a 9 billion parameter language model derived from the original Qwen/Qwen3.5-9B checkpoint. Its primary distinction lies in the inclusion of a generation_config.json file, which is absent in the upstream Qwen 4B/9B models.

Key Enhancements

• Correct Generation Termination: The added generation_config.json explicitly defines both <|im_end|> (248046) and <|endoftext|> (248044) as eos_token_ids. This ensures that inference engines like sglang and vLLM correctly halt generation at the end of each conversational turn.
• Prevents Runaway Generation: By properly recognizing the chat turn terminator <|im_end|>, this model variant prevents common issues of runaway generation in multi-turn dialogues or tool-use rollouts, which can occur when only <|endoftext|> is used for termination.

Ideal Use Cases

• Multi-turn Chatbots: Ensures conversations terminate naturally after each model response.
• Tool-use Scenarios: Facilitates precise control over generation boundaries when integrating with external tools.
• Applications requiring reliable turn-taking: Any application where explicit control over the end of a model's output in a sequence is critical.