arcee-ai/Llama-3-OpenBioLLM-JSL-8B-SLERP

TEXT GENERATIONConcurrency Cost:1Model Size:8BQuant:FP8Ctx Length:8kPublished:Apr 28, 2024License:apache-2.0Architecture:Transformer Open Weights Cold

arcee-ai/Llama-3-OpenBioLLM-JSL-8B-SLERP is an 8 billion parameter language model merged from aaditya/OpenBioLLM-Llama3-8B and johnsnowlabs/JSL-Med-Sft-Llama-3-8B using the SLERP method. This model is specifically designed for biomedical and medical natural language processing tasks, leveraging the strengths of its base models. It offers a context length of 8192 tokens, making it suitable for processing extensive medical texts and scientific literature.

Loading preview...

Model Overview

arcee-ai/Llama-3-OpenBioLLM-JSL-8B-SLERP is an 8 billion parameter language model created by arcee-ai through a merge of two specialized Llama 3-based models: aaditya/OpenBioLLM-Llama3-8B and johnsnowlabs/JSL-Med-Sft-Llama-3-8B. This merge was performed using the SLERP (Spherical Linear Interpolation) method via mergekit, combining their respective strengths.

Key Capabilities

  • Biomedical and Medical NLP: Inherits and combines the specialized knowledge from its base models, making it highly proficient in understanding and generating text related to biology, medicine, and healthcare.
  • Llama 3 Architecture: Built upon the robust Llama 3 foundation, providing strong general language understanding capabilities.
  • 8B Parameters: Offers a balance between performance and computational efficiency for specialized tasks.
  • 8192 Token Context Length: Capable of processing and generating longer sequences of text, which is beneficial for detailed medical reports, research papers, and clinical notes.

Good For

  • Medical Information Extraction: Extracting key entities, relationships, and facts from clinical notes, research articles, and patient records.
  • Biomedical Text Generation: Creating summaries, answering questions, or generating reports within the biomedical domain.
  • Healthcare Applications: Developing AI solutions that require deep understanding of medical terminology and concepts.
  • Research in Life Sciences: Assisting with literature review, hypothesis generation, and data analysis in biological and medical fields.

Finetunes
1 models