AmberYifan/capsd-medicine-dedup-marin-8b-base-medicine_cap_b10000_s0
The AmberYifan/capsd-medicine-dedup-marin-8b-base-medicine_cap_b10000_s0 model is an 8 billion parameter language model, fine-tuned from marin-community/marin-8b-base. It was trained on the capsd_marin-8b-base-n80000-medicine-dedup80k__mix_medicine_cap_b10000_s0 dataset, suggesting a specialization in medical or healthcare-related text processing. With a context length of 8192 tokens, this model is likely optimized for tasks requiring understanding and generation within the medical domain.
Loading preview...
Model Overview
This model, AmberYifan/capsd-medicine-dedup-marin-8b-base-medicine_cap_b10000_s0, is an 8 billion parameter language model fine-tuned from the marin-community/marin-8b-base architecture. It was specifically trained on the capsd_marin-8b-base-n80000-medicine-dedup80k__mix_medicine_cap_b10000_s0 dataset, indicating a strong focus on medical and healthcare-related text.
Key Characteristics
- Base Model: Fine-tuned from
marin-community/marin-8b-base. - Parameter Count: 8 billion parameters.
- Context Length: Supports a context window of 8192 tokens.
- Specialization: The training dataset suggests a specialization in processing and generating content relevant to the medical domain.
Training Details
The model underwent a single epoch of training with a learning rate of 1e-05, a total batch size of 64, and utilized the AdamW optimizer. The training was performed using Transformers 5.7.0, Pytorch 2.13.0+cu130, Datasets 4.0.0, and Tokenizers 0.22.2.
Potential Use Cases
Given its fine-tuning on a medical dataset, this model is likely suitable for applications requiring domain-specific knowledge in medicine, such as:
- Medical text summarization.
- Question answering in healthcare contexts.
- Generating medical reports or documentation.
- Assisting with clinical decision support systems.