microsoft/MediPhi-MedCode

Overview

The microsoft/MediPhi-MedCode model is a 3.8 billion parameter small language model (SLM) developed by Microsoft Healthcare & Life Sciences. It is part of the MediPhi Model Collection, which specializes in medical and clinical domains. This particular model is derived from Phi-3.5-mini-instruct and has been fine-tuned specifically for medical coding using the SLERP merging method, integrating an expert trained on various medical coding datasets (ICD10CM, ICD10PROC, ICD9CM, ICD9PROC, and ATC).

Key Capabilities

• Medical Domain Specialization: Optimized for clinical natural language processing tasks, particularly medical coding.
• Modular Design: Part of a collection of expert models, allowing for focused domain adaptation while retaining general abilities.
• Performance: Demonstrates strong performance on medical benchmarks, achieving 68.7% on ICD10CM in the CLUE+ benchmark, significantly outperforming its base model.
• Efficiency: Designed for research in memory/compute constrained and latency-bound environments.
• Safety: Retains the safety capabilities of its base model, Phi-3.5-mini-instruct, with demonstrated conservation of safety behaviors against jailbreaking and harmfulness.

Good For

• Clinical NLP Research: Ideal for researchers working on language models in medical and clinical scenarios.
• Medical Coding: Specifically strong in tasks related to medical coding, as indicated by its training data and benchmark results.
• Resource-Constrained Deployments: Suitable for environments with limited computational resources or strict latency requirements.
• Benchmarking: Intended for use in benchmarking contexts or with expert user verification of outputs due to its research-oriented nature.