AmberYifan/capsd-marin-8b-base-code_cap_b12000_s0

TEXT GENERATIONPricing:Input $0.37 / Cached $0.074 / Output $0.38Concurrent Unit Cost:1Model Size:8BQuant:FP8Context Size:8kTool Calling:SupportedPublished:Aug 5, 2026License:otherArchitecture:Transformer Featherless Exclusive Cold

The AmberYifan/capsd-marin-8b-base-code_cap_b12000_s0 model is an 8 billion parameter language model, fine-tuned from marin-community/marin-8b-base. It was trained on the capsd_marin-8b-base-n80000-opc__mix_code_cap_b12000_s0 dataset, suggesting a specialization in code-related tasks. This model is designed for applications requiring a compact yet capable language model with a focus on code understanding or generation, leveraging its 8192 token context length.

Loading preview...

Model Overview

AmberYifan/capsd-marin-8b-base-code_cap_b12000_s0 is an 8 billion parameter language model, fine-tuned from the marin-community/marin-8b-base architecture. This model has been specifically adapted using the capsd_marin-8b-base-n80000-opc__mix_code_cap_b12000_s0 dataset, indicating a potential specialization in code-related applications.

Training Details

The model underwent a single epoch of training with a learning rate of 1e-05. Key hyperparameters included:

  • Optimizer: ADAMW_TORCH with betas=(0.9, 0.999) and epsilon=1e-08.
  • Batch Size: A train_batch_size of 2 and eval_batch_size of 8, with a gradient_accumulation_steps of 8, resulting in a total_train_batch_size of 64.
  • Scheduler: Cosine learning rate scheduler with 0.03 warmup steps.

Framework Versions

The training utilized:

  • Transformers 5.7.0
  • Pytorch 2.13.0+cu130
  • Datasets 4.0.0
  • Tokenizers 0.22.2

Potential Use Cases

Given its fine-tuning on a code-centric dataset, this model is likely suitable for tasks such as:

  • Code generation and completion.
  • Code summarization or explanation.
  • Assisting with programming-related queries.

Finetunes
1 models