bilalRahib/TinyLLama-NSFW-Chatbot
TEXT GENERATIONConcurrency Cost:1Model Size:1.1BQuant:BF16Ctx Length:2kPublished:Mar 2, 2024License:apache-2.0Architecture:Transformer0.0K Open Weights Warm
bilalRahib/TinyLLama-NSFW-Chatbot is a 1.1 billion parameter Llama-based causal language model developed by bilalRahib. Fine-tuned from unsloth/tinyllama-bnb-4bit, this model is optimized for NSFW chatbot applications. It was trained using Unsloth and Huggingface's TRL library, enabling faster training times. The model has a context length of 2048 tokens.
Loading preview...
Overview
bilalRahib/TinyLLama-NSFW-Chatbot is a compact 1.1 billion parameter language model, specifically fine-tuned for NSFW (Not Safe For Work) chatbot interactions. Developed by bilalRahib, this model leverages the Llama architecture and was built upon the unsloth/tinyllama-bnb-4bit base model.
Key Characteristics
- Parameter Count: 1.1 billion parameters, making it a relatively small and efficient model.
- Base Model: Fine-tuned from
unsloth/tinyllama-bnb-4bit. - Training Efficiency: Utilizes Unsloth and Huggingface's TRL library for accelerated training, reportedly achieving 2x faster training speeds.
- Context Length: Supports a context window of 2048 tokens.
- License: Distributed under the Apache-2.0 license.
Intended Use Cases
This model is specifically designed and optimized for:
- NSFW Chatbot Applications: Its primary purpose is to generate responses suitable for adult-oriented conversational agents.
- Resource-Constrained Environments: Due to its smaller parameter count, it may be suitable for deployment in environments with limited computational resources where larger models are impractical.