abdoul-rz/qwen3-4b-beauty-mix

Model Overview

The abdoul-rz/qwen3-4b-beauty-mix is a 4 billion parameter language model, fine-tuned by abdoul-rz from the base Qwen/Qwen3-4B architecture. This model has been specifically trained on the beauty-mix dataset, suggesting a specialization in processing and generating content related to the beauty industry, products, or related topics. It supports a substantial context length of 32768 tokens, allowing for the analysis and generation of detailed and lengthy beauty-focused texts.

Key Capabilities

• Specialized Domain Knowledge: Fine-tuned on the beauty-mix dataset, indicating enhanced performance for tasks within the beauty domain.
• Large Context Window: With a 32768 token context length, it can handle extensive inputs and generate comprehensive outputs relevant to beauty topics.
• Qwen3-4B Foundation: Benefits from the robust architecture and general language understanding capabilities of the Qwen3-4B base model.

Training Details

The model was trained with a learning rate of 5e-05, a total batch size of 128 (across 4 GPUs with gradient accumulation), and utilized the AdamW_Torch_Fused optimizer. Training was conducted for 1.0 epoch, employing a cosine learning rate scheduler with a 0.1 warmup ratio.

Intended Use Cases

This model is likely best suited for applications requiring deep understanding or generation of text within the beauty sector. Potential uses include:

• Generating product descriptions for beauty items.
• Creating beauty-related articles, reviews, or social media content.
• Analyzing customer feedback or trends in the beauty industry.
• Developing chatbots or virtual assistants for beauty brands.