tomhu/RL4TG-Qwen2.5-3B-OPD-GRPO-1-Epoch

Model Overview

This model, tomhu/RL4TG-Qwen2.5-3B-OPD-GRPO-1-Epoch, is a specialized checkpoint derived from the Qwen/Qwen2.5-3B-Instruct base model. It has been fine-tuned using a unique training methodology combining OPD (Optimal Policy Distillation) initialization followed by GRPO (Generalized Reinforcement Learning for Policy Optimization) over one epoch (50 steps).

Key Capabilities

• Java Unit-Test Generation: The primary function of this model is to generate Java unit tests, making it highly specialized for software testing and development workflows.
• Reinforcement Learning Fine-tuning: It leverages advanced reinforcement learning techniques (OPD and GRPO) to enhance its performance in the target domain.
• Teacher Model Guidance: During the OPD phase, Qwen/Qwen2.5-Coder-7B-Instruct served as a teacher, guiding the model's learning process for code-related tasks.
• Specific Training Data: Trained on 1,582 mutation-eligible Defects4J samples, ensuring relevance to real-world Java codebases.

Good For

• Research in Automated Testing: Ideal for researchers exploring methods for automated Java unit-test generation and reinforcement learning applications in code synthesis.
• Developing Test Automation Tools: Can serve as a component in systems designed to automatically create or augment test suites for Java projects.

Limitations

• The generated tests require compilation and execution within the target project's build environment to verify their correctness and efficacy.