TsinghuaC3I/Llama-3-70B-UltraMedical
Llama-3-70B-UltraMedical is a 70 billion parameter open-access large language model developed by the Tsinghua C3I Lab, specialized in biomedicine. Built upon Meta's Llama-3-70B, it is fine-tuned using supervised fine-tuning (SFT) and iterative preference learning on the UltraMedical dataset, which comprises 410,000 synthetic and manually curated biomedical samples. This model is designed to enhance medical examination access, literature comprehension, and clinical knowledge, offering specialized capabilities for biomedical applications.
Loading preview...
UltraMedical: Specialized Generalist in Biomedicine
Llama-3-70B-UltraMedical is an open-access large language model (LLM) developed by the Tsinghua C3I Lab, specifically designed for biomedical applications. It is built on Meta's Llama-3-70B foundation and has been extensively fine-tuned to achieve specialized performance in the medical domain.
Key Capabilities & Training
- Biomedical Specialization: The model is tailored to enhance medical examination access, improve literature comprehension, and deepen clinical knowledge.
- Advanced Fine-tuning: Training involved supervised fine-tuning (SFT) and iterative preference learning methods, including DPO and KTO.
- High-Quality Dataset: Fine-tuned on the proprietary UltraMedical collection, which consists of 410,000 high-quality synthetic and manually curated biomedical instruction samples, alongside over 100,000 preference data points.
Use Cases
- Medical Information Retrieval: Assisting with finding and understanding medical information.
- Clinical Knowledge Support: Providing insights and aiding in the comprehension of clinical data.
- Biomedical Literature Analysis: Facilitating the understanding and summarization of scientific papers.
This model aims to serve as a specialized generalist, bridging the gap between general LLMs and the specific demands of the biomedical field.