laion/allenai-sera-unified-100000-opt100k__Qwen3-8B

TEXT GENERATIONConcurrency Cost:1Model Size:8BQuant:FP8Ctx Length:32kPublished:Apr 1, 2026License:otherArchitecture:Transformer Cold

The laion/allenai-sera-unified-100000-opt100k__Qwen3-8B model is an 8 billion parameter language model, fine-tuned from the Qwen/Qwen3-8B architecture. It was trained on the laion/allenai-sera-unified-100000 dataset, suggesting a specialization in areas related to the SERA project's data. This model is likely optimized for tasks aligned with the specific data distribution of its fine-tuning dataset, offering enhanced performance in those domains.

Loading preview...

Model Overview

This model, laion/allenai-sera-unified-100000-opt100k__Qwen3-8B, is an 8 billion parameter language model built upon the Qwen/Qwen3-8B architecture. It has undergone fine-tuning using the /e/data1/datasets/playground/ot/hf_hub/datasets--laion--allenai-sera-unified-100000/snapshots/c2dd4cd7f728345083ab5cfd4017902514c3c29f_thinking_preprocessed dataset.

Training Details

The fine-tuning process involved specific hyperparameters:

  • Learning Rate: 4e-05
  • Batch Sizes: train_batch_size of 1, eval_batch_size of 8, with a gradient_accumulation_steps of 3, resulting in a total_train_batch_size of 96.
  • Optimizer: AdamW_Torch_Fused with default betas and epsilon.
  • Scheduler: Cosine learning rate scheduler with a 0.1 warmup ratio.
  • Epochs: Trained for 5.0 epochs across 32 devices.

Potential Use Cases

Given its fine-tuning on a specific dataset, this model is likely best suited for applications that align with the data characteristics of the laion/allenai-sera-unified-100000 dataset. Developers should investigate the nature of this dataset to determine optimal use cases.

Finetunes
1 models