TorpedoSoftware/Luau-Devstral-24B-Instruct-v0.1
Luau-Devstral-24B-Instruct-v0.1 by TorpedoSoftware is a 24 billion parameter instruction-tuned language model, fine-tuned from Devstral Small 2507. It specializes in Roblox Luau programming, leveraging a corpus of permissively licensed Luau code and Roblox documentation. This model is optimized for local inference and excels at generating Luau code and understanding Roblox development contexts.
Loading preview...
Overview
TorpedoSoftware's Luau-Devstral-24B-Instruct-v0.1 is a 24 billion parameter instruction-tuned model, developed by Zack Williams (boatbomber) and funded by Torpedo Software LLC. It is a specialized fine-tune of the powerful Devstral Small 2507 model, designed to address the limited representation of Roblox game development and Luau programming in general LLM training data.
Key Capabilities
- Specialized Luau Programming: Significantly enhanced capabilities for generating and understanding Luau code, crucial for Roblox development.
- Roblox Documentation Comprehension: Improved understanding of Roblox's extensive documentation, enabling more accurate and context-aware responses.
- Efficient Local Inference: Built upon Devstral Small 2507, which is noted for strong performance in local inference scenarios.
- Custom System Prompt: Utilizes a Jinja chat template with a default system prompt to further steer the model towards Luau-specific tasks.
Training Details
The model was fine-tuned using a LoRA adapter on two custom datasets:
- The Luau Stack: 25.917 million lines (0.452 billion tokens) of real Luau code.
- Roblox Info Dump: 19.6 thousand pages (0.149 billion tokens) of multilingual Roblox documentation.
Good For
- Developers working with Roblox and Luau programming.
- Generating Luau code snippets or full scripts.
- Querying information related to Roblox development and its API.
- Applications requiring a strong understanding of the Roblox ecosystem.