AmberYifan/capsd-marin-8b-base-math_less_b8000_s0

TEXT GENERATIONPricing:Input $0.37 / Cached $0.074 / Output $0.38Concurrent Unit Cost:1Model Size:8BQuant:FP8Context Size:8kTool Calling:SupportedPublished:Jul 30, 2026License:otherArchitecture:Transformer Featherless Exclusive Cold

AmberYifan/capsd-marin-8b-base-math_less_b8000_s0 is an 8 billion parameter language model fine-tuned from marin-community/marin-8b-base. This model is specifically optimized for mathematical tasks, leveraging the capsd_marin-8b-base-n80000-numina__mix_math_less_b8000_s0 dataset. It features an 8192 token context length and is designed for applications requiring enhanced mathematical reasoning capabilities.

Loading preview...

Model Overview

AmberYifan/capsd-marin-8b-base-math_less_b8000_s0 is an 8 billion parameter language model, fine-tuned from the marin-community/marin-8b-base architecture. This model has been specifically trained on the capsd_marin-8b-base-n80000-numina__mix_math_less_b8000_s0 dataset, indicating a focus on improving its performance in mathematical domains. It supports a context length of 8192 tokens.

Training Details

The model was trained using the following hyperparameters:

  • Learning Rate: 1e-05
  • Batch Sizes: train_batch_size of 2, eval_batch_size of 8
  • Gradient Accumulation: 8 steps, leading to a total_train_batch_size of 64
  • Optimizer: ADAMW_TORCH with default betas and epsilon
  • LR Scheduler: Cosine type with 0.03 warmup steps
  • Epochs: 1

Key Capabilities

  • Mathematical Reasoning: Fine-tuned on a specialized mathematical dataset to enhance performance in math-related tasks.
  • Base Model Foundation: Built upon the marin-8b-base model, inheriting its general language understanding capabilities.

Intended Use Cases

This model is suitable for applications requiring improved mathematical problem-solving and understanding. Developers can leverage its specialized training for tasks where numerical and logical reasoning are critical.