AmberYifan/capsd-medcase-marin-8b-base-medicine_cap_b1000_s0
AmberYifan/capsd-medcase-marin-8b-base-medicine_cap_b1000_s0 is an 8 billion parameter language model fine-tuned from marin-community/marin-8b-base. This model is specifically adapted for medical applications, having been trained on the capsd_marin-8b-base-n13092-medicine-medcase__mix_medicine_cap_b1000_s0 dataset. It is optimized for tasks within the medical domain, leveraging its 8192 token context length for processing relevant information.
Loading preview...
Model Overview
This model, AmberYifan/capsd-medcase-marin-8b-base-medicine_cap_b1000_s0, is an 8 billion parameter language model. It is a fine-tuned variant of the marin-community/marin-8b-base architecture, specifically adapted for medical use cases.
Key Characteristics
- Base Model: Fine-tuned from
marin-community/marin-8b-base. - Parameter Count: 8 billion parameters.
- Context Length: 8192 tokens.
- Specialization: Optimized for the medical domain through targeted fine-tuning.
Training Details
The model was trained using the capsd_marin-8b-base-n13092-medicine-medcase__mix_medicine_cap_b1000_s0 dataset. Key training hyperparameters included a learning rate of 1e-05, a total train batch size of 64, and 1 epoch of training. The training utilized a cosine learning rate scheduler and was performed on a multi-GPU setup with 4 devices.
Intended Use Cases
While specific intended uses and limitations require further information, its fine-tuning on a medical dataset suggests suitability for applications requiring understanding and generation of medical-related text. Developers should consider its domain-specific training for tasks within healthcare, research, or clinical support where a specialized language model is beneficial.