AmberYifan/capsdnum-marin-8b-base-code_ppl_b4000_s0

TEXT GENERATIONConcurrent Unit Cost:1Model Size:8BQuant:FP8Context Size:8kTool Calling:SupportedPublished:Jul 17, 2026License:otherArchitecture:Transformer Featherless Exclusive Cold

AmberYifan/capsdnum-marin-8b-base-code_ppl_b4000_s0 is an 8 billion parameter language model, fine-tuned from marin-community/marin-8b-base. This model was trained on the capsd_marin-8b-base-n80000-opc__mix_code_ppl_b4000_s0 dataset, suggesting a specialization in code-related tasks. With an 8192 token context length, it is likely optimized for processing and generating code or technical text.

Loading preview...

Model Overview

The AmberYifan/capsdnum-marin-8b-base-code_ppl_b4000_s0 is an 8 billion parameter language model, fine-tuned from the marin-community/marin-8b-base architecture. It was specifically trained on the capsd_marin-8b-base-n80000-opc__mix_code_ppl_b4000_s0 dataset, indicating a focus on code-related applications.

Training Details

The model underwent a fine-tuning process with the following key hyperparameters:

  • Learning Rate: 1e-05
  • Optimizer: ADAMW_TORCH with betas=(0.9, 0.999) and epsilon=1e-08
  • Batch Size: A total training batch size of 64 (train_batch_size: 2, gradient_accumulation_steps: 8)
  • Epochs: 1
  • Scheduler: Cosine learning rate scheduler with 0.03 warmup steps

Potential Use Cases

Given its fine-tuning on a code-centric dataset, this model is likely suitable for:

  • Code generation and completion
  • Code understanding and analysis
  • Assisting with programming tasks

Further details regarding specific capabilities, limitations, and evaluation data are not provided in the current model card.

Finetunes
1 models