AmberYifan/capsdnum-marin-8b-base-code_ppl_b8000_s0

TEXT GENERATIONConcurrent Unit Cost:1Model Size:8BQuant:FP8Context Size:8kTool Calling:SupportedPublished:Jul 17, 2026License:otherArchitecture:Transformer Featherless Exclusive Cold

AmberYifan/capsdnum-marin-8b-base-code_ppl_b8000_s0 is an 8 billion parameter language model, fine-tuned from marin-community/marin-8b-base. This model was specifically trained on the capsd_marin-8b-base-n80000-opc__mix_code_ppl_b8000_s0 dataset, suggesting an optimization for code-related tasks. It utilizes a context length of 8192 tokens, making it suitable for processing moderately long sequences of text or code.

Loading preview...

Model Overview

AmberYifan/capsdnum-marin-8b-base-code_ppl_b8000_s0 is an 8 billion parameter language model, fine-tuned from the marin-community/marin-8b-base architecture. This model has been specifically adapted through further training on a specialized dataset, capsd_marin-8b-base-n80000-opc__mix_code_ppl_b8000_s0.

Training Details

The fine-tuning process involved specific hyperparameters:

  • Learning Rate: 1e-05
  • Batch Sizes: train_batch_size of 2, eval_batch_size of 8
  • Gradient Accumulation: 8 steps, leading to a total_train_batch_size of 64
  • Optimizer: ADAMW_TORCH with default betas and epsilon
  • LR Scheduler: Cosine type with 0.03 warmup steps
  • Epochs: 1

Potential Use Cases

Given its fine-tuning on a dataset explicitly mentioning "code_ppl", this model is likely optimized for tasks related to code generation, understanding, or processing. Developers might consider this model for applications requiring code-aware language capabilities.

Finetunes
1 models