EnnoAi/EnnoAi-Pro-Llama-3.1-8B-v1.0
TEXT GENERATIONConcurrency Cost:1Model Size:8BQuant:FP8Ctx Length:32kPublished:Aug 22, 2024License:apache-2.0Architecture:Transformer Open Weights Cold
EnnoAi/EnnoAi-Pro-Llama-3.1-8B-v1.0 is an 8 billion parameter Llama 3.1-based model developed by EnnoAi, specifically fine-tuned for professional use with French language content. It is optimized for Retrieval Augmented Generation (RAG) applications, leveraging a curated French professional dataset. The model is designed to provide accurate and relevant responses when integrated with external knowledge bases.
Loading preview...
EnnoAi-Pro-Llama-3.1-8B-v1.0 Overview
EnnoAi-Pro-Llama-3.1-8B-v1.0 is an 8 billion parameter model built upon the Llama 3.1 architecture, developed by EnnoAi. This beta version is specifically engineered for professional applications requiring robust French language processing.
Key Capabilities
- French Language Specialization: Fine-tuned on a selected French professional dataset, making it highly proficient in understanding and generating French text.
- Retrieval Augmented Generation (RAG) Optimized: Designed to work effectively with RAG systems, allowing users to inject custom content via the system prompt for context-aware responses.
- QLoRA Fine-tuning: Utilizes QLoRA methods over two epochs for efficient and targeted adaptation to its specialized domain.
Intended Use Cases
- Professional French Applications: Ideal for businesses and organizations requiring a language model tailored for French professional communication.
- RAG Implementations: Best suited for scenarios where external, domain-specific knowledge needs to be integrated to answer user queries accurately.
- Contextual Question Answering: Users can leverage the system prompt to provide RAG content, enabling the model to answer questions based on the provided context.