barath007183/qwen2.5-1.5b-yoda-speak

Model Overview

This model, developed by Barath, is a LoRA fine-tune of the Qwen2.5-1.5B-Instruct base model, designed specifically to translate English sentences into Yoda-style syntax. It focuses on reordering sentence structure (e.g., object-verb-first) rather than altering vocabulary. The project served as a hands-on exploration of LoRA fine-tuning, including data preparation, chat-template formatting, loss masking, and hyperparameter optimization.

Key Capabilities

• Yoda-Speak Translation: Rewrites plain English sentences into Yoda's distinctive speaking style.
• Stylistic Reordering: Primarily performs object-subject-verb reordering.
• Fine-tuned for Specificity: Optimized for single, self-contained declarative sentences, questions, negations, and imperatives.

When to Use This Model

• Direct Translation: Ideal for translating short, clear English sentences into Yoda-speak.
• Learning Resource: Useful for understanding LoRA fine-tuning mechanics and the nuances of checkpoint selection on small datasets.

Limitations and Considerations

• Scope: Not intended for general Q&A, factual assistance, or tasks beyond stylistic sentence reordering.
• Performance Degradation: Output quality degrades significantly on longer multi-clause paragraphs, dialogue-heavy text, or inputs substantially different from the training data (720 examples from dvgodoy/yoda_sentences).
• Failure Mode: On challenging inputs, the model tends to "under-transform" (revert to plain English) rather than producing garbled or incorrect reorderings, which was a deliberate choice during checkpoint selection.
• No Safety Evaluation: Inherits the base model's safety characteristics; no specific toxicity evaluation was performed.