AdaptLLM/medicine-chat

Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:7BQuant:FP8Ctx Length:4kPublished:Dec 9, 2023License:llama2Architecture:Transformer0.1K Open Weights Warm

AdaptLLM/medicine-chat is a 7 billion parameter LLaMA-2-Chat-7B based model developed by AdaptLLM, specifically fine-tuned for the biomedicine domain. It utilizes a novel method of transforming large-scale pre-training corpora into reading comprehension texts to enrich domain knowledge while preserving prompting ability. This model is designed to excel in question answering and conversational tasks within the medical field, demonstrating competitive performance against much larger domain-specific models.

Loading preview...

AdaptLLM/medicine-chat: Domain-Adapted LLaMA-2 for Biomedicine

AdaptLLM/medicine-chat is a 7 billion parameter language model derived from LLaMA-2-Chat-7B, specifically adapted for the biomedicine domain. Developed by AdaptLLM, this model leverages a unique approach of continual pre-training on domain-specific corpora by transforming these into reading comprehension texts. This method effectively enriches the model with specialized knowledge without compromising its general prompting capabilities for question answering.

Key Capabilities

  • Domain-Specific Expertise: Excels in understanding and generating text related to biomedicine, trained on relevant corpora.
  • Reading Comprehension Method: Utilizes a novel technique to integrate domain knowledge, inspired by human learning processes.
  • Competitive Performance: Achieves performance comparable to significantly larger domain-specific models, such as BloombergGPT-50B, within its specialized field.
  • Chat Model: Designed for conversational interactions, fitting the LLaMA-2-Chat data format by converting reading comprehension into multi-turn conversations.

Good For

  • Biomedical Question Answering: Ideal for tasks requiring accurate and contextually relevant answers within the medical domain.
  • Domain-Specific Chatbots: Suitable for developing conversational AI agents focused on healthcare, research, or medical information.
  • Research and Development: Provides a strong foundation for further fine-tuning or research in domain adaptation for LLMs.

Finetunes
2 models