AmberYifan/capsd-medcase-marin-8b-base-medicine_cap_b4000_s0
AmberYifan/capsd-medcase-marin-8b-base-medicine_cap_b4000_s0 is an 8 billion parameter language model, fine-tuned from the marin-community/marin-8b-base architecture. This model is specifically adapted for medical applications, leveraging the capsd_marin-8b-base-n13092-medicine-medcase__mix_medicine_cap_b4000_s0 dataset. It is designed to perform tasks within the medical domain, building upon its base model's capabilities with specialized knowledge.
Loading preview...
Model Overview
This model, AmberYifan/capsd-medcase-marin-8b-base-medicine_cap_b4000_s0, is an 8 billion parameter language model. It is a fine-tuned variant of the marin-community/marin-8b-base architecture, specifically adapted for medical contexts.
Key Characteristics
- Base Model: Fine-tuned from
marin-community/marin-8b-base. - Parameter Count: 8 billion parameters.
- Context Length: 8192 tokens.
- Specialization: Enhanced for medical applications through targeted fine-tuning.
Training Details
The model was trained using the capsd_marin-8b-base-n13092-medicine-medcase__mix_medicine_cap_b4000_s0 dataset. Key training hyperparameters included a learning rate of 1e-05, a total training batch size of 64, and a single epoch. The training utilized a multi-GPU setup with 4 devices and an AdamW optimizer with a cosine learning rate scheduler.
Potential Use Cases
Given its fine-tuning on a medical dataset, this model is likely suitable for tasks requiring specialized knowledge in the medicine domain. Developers could explore its application in areas such as medical text analysis, information extraction from clinical notes, or supporting medical research.