18-Death/sq-atbash-rot13-gsm8k
The 18-Death/sq-atbash-rot13-gsm8k is a 3.1 billion parameter language model fine-tuned using the TRL framework. This model is designed for text generation tasks, leveraging its 32768 token context length to process and generate coherent responses. Its training procedure, based on Supervised Fine-Tuning (SFT), focuses on general text generation capabilities.
Loading preview...
Overview
The 18-Death/sq-atbash-rot13-gsm8k is a 3.1 billion parameter language model, fine-tuned for text generation. It was developed by 18-Death and utilizes the TRL (Transformers Reinforcement Learning) framework for its training process. The model is built upon an unspecified base model and has undergone Supervised Fine-Tuning (SFT).
Key Capabilities
- Text Generation: Capable of generating human-like text based on provided prompts.
- Context Handling: Features a substantial context length of 32768 tokens, allowing for processing longer inputs and maintaining conversational coherence over extended interactions.
Training Details
The model's training procedure involved Supervised Fine-Tuning (SFT) using the TRL library (version 1.3.0), alongside Transformers (version 5.6.2), Pytorch (version 2.10.0), Datasets (version 4.8.4), and Tokenizers (version 0.22.2).
Good For
This model is suitable for general text generation tasks where a moderate-sized model with a good context window is beneficial. It can be used for answering questions, creative writing, or generating conversational responses, as demonstrated by its quick start example.