Luau-Devstral-24B-Instruct-v0.2: Specialized Luau Code Generation

This model, developed by Zack Williams (boatbomber) and sponsored by Torpedo Software LLC, is a 24 billion parameter instruction-tuned language model specifically engineered for generating high-quality Luau code. It is an enhanced version of Luau-Devstral-24B-Instruct-v0.1, refined using Dr. GRPO (Group Relative Policy Optimization) for superior performance in Roblox development.

Key Capabilities & Performance:

• State-of-the-art code quality: Achieves the lowest linter errors and warnings, and exceptional code formatting adherence.
• High type safety: Ranks 2nd in strict mode typechecking compliance, favoring explicit type definitions.
• Concise responses: Delivers direct solutions without unnecessary verbosity, making it efficient for integration.
• Solid problem-solving: Ranks 4th overall in unit test pass rates on the LuauLeetcode benchmark, outperforming several OpenAI models.

Training & Optimization:

The model was trained using a curriculum learning approach on the TorpedoSoftware/LuauLeetcode dataset, progressing from easy to hard challenges. Optimization involved a unique reward function design incorporating correctness (unit testing), code quality (linting), type safety (Luau typechecking), and formatting (Stylua conformance).

Ideal Use Cases:

• Generating robust and type-safe Luau code for Roblox projects.
• Automating code formatting and linting tasks in Luau development workflows.
• Developers seeking highly optimized and concise code solutions for Luau programming challenges.