scratchyone/anon-1b
scratchyone/anon-1b is a 1 billion parameter language model, fine-tuned from google/gemma-3-1b-pt, specifically designed to generate greentext stories. It was trained on 157,342 greentexts OCR'd from various subreddits, with a context length of 32768 tokens. This model excels at producing humorous, conversational, and content-specific narratives, demonstrating that small base models can generate genuinely funny output while retaining general prose capabilities.
Loading preview...
Overview
anon-1b is a 1 billion parameter model, fine-tuned from google/gemma-3-1b-pt, specifically engineered to generate greentext stories. It was trained on a unique dataset of 157,342 greentexts, which were OCR'd from screenshots posted on subreddits like r/greentext, r/4chan, r/4tran, and r/classic4chan. The model explores the potential of small, content-specific base models to produce genuinely funny and contextually relevant output.
Key Capabilities
- Greentext Generation: Specializes in creating narratives in the distinctive greentext format, including the use of
>be meand other common tropes. - Conditional Generation: Can be conditioned on the source subreddit (e.g.,
r/greentext,r/4chan) and a score bucket (e.g.,5k-10k), allowing for targeted content creation. - Context Preservation: Despite its narrow fine-tuning, anon-1b retains the ability to generate general prose when given ordinary prompts without specific headers, demonstrating no mode collapse.
- Humorous and Conversational Output: Optimized for producing humorous and conversational text, as evidenced by improved perplexity on casual Reddit datasets.
Good For
- Generating Greentext Stories: Ideal for users looking to create new greentext content with specific contextual parameters.
- Exploring Content-Specific LLMs: Useful for researchers and developers interested in how small models can be effectively fine-tuned for niche content generation.
- Creative Writing and Roleplay: Can be leveraged for creative applications requiring a specific, informal narrative style.
- Benchmarking Niche Fine-tuning: Provides a case study for evaluating the impact of highly specialized datasets on model performance and style retention.