lamm-mit/BioinspiredLLM

TEXT GENERATIONConcurrency Cost:1Model Size:13BQuant:FP8Ctx Length:4kPublished:Dec 13, 2023Architecture:Transformer0.0K Cold

BioinspiredLLM is a 13 billion parameter conversational large language model developed by lamm-mit, fine-tuned from Orca-2 (based on LLaMA-2 13B). It is specifically optimized for the mechanics of biological and bio-inspired materials, trained on over a thousand peer-reviewed articles in this domain. The model excels at recalling information, assisting with research tasks, and generating hypotheses related to biological materials design, further enhanced by Retrieval-Augmented Generation (RAG) capabilities.

Loading preview...

BioinspiredLLM: Specialized Conversational AI for Bio-Inspired Materials

BioinspiredLLM is a 13 billion parameter large language model developed by lamm-mit, fine-tuned from the Orca-2 model, which itself is based on LLaMA-2 13B. This model is uniquely specialized for the mechanics of biological and bio-inspired materials, having been trained on a comprehensive corpus of over a thousand peer-reviewed articles in this field.

Key Capabilities

  • Domain-Specific Knowledge: Accurately recalls information and assists with research tasks within biological and bio-inspired materials science.
  • Enhanced Reasoning: Demonstrates strengthened reasoning abilities for complex materials science problems.
  • Hypothesis Generation: Capable of developing sound hypotheses, even for materials not explicitly studied during training.
  • Retrieval-Augmented Generation (RAG): Integrates new data during generation, allowing for traceability of sources and dynamic knowledge base updates.
  • Collaborative AI Workflows: Shows promise in collaborating with other generative AI models to reshape traditional materials design processes.

Performance

Evaluations show BioinspiredLLM, particularly with RAG, outperforms Llama 13b-chat and Orca-2 13b in knowledge recall on a 100-question biological materials exam, across general, specific, numerical, and non-biological question categories.

Good For

  • Researchers and engineers in biological and bio-inspired materials science seeking a specialized AI assistant.
  • Generating insights and hypotheses for novel material designs.
  • Accelerating discovery and understanding in the field through conversational interaction.
  • Integrating with RAG systems for verifiable and up-to-date information retrieval.