Enno-Ai/EnnoAi-Pro-French-Llama-3-8B-v0.4
Enno-Ai/EnnoAi-Pro-French-Llama-3-8B-v0.4 is an 8 billion parameter Llama 3-based model developed by Enno-Ai, specifically fine-tuned for professional use cases in French. This model leverages a selected French professional dataset and QLora methods for tuning, offering a context length of 8192 tokens. It is designed to handle French-specific professional tasks, distinguishing it from general-purpose multilingual models.
Loading preview...
EnnoAi-Pro-French-Llama-3-8B-v0.4 Overview
Enno-Ai/EnnoAi-Pro-French-Llama-3-8B-v0.4 is an alpha version of a French professional language model, built upon the Llama 3 architecture with 8 billion parameters. Developed by Enno-Ai, this model is specifically designed for professional applications requiring strong French language capabilities.
Key Characteristics
- French Professional Focus: The model has been fine-tuned using a carefully selected French professional dataset, aiming for high performance in domain-specific tasks.
- Tuning Methodology: It utilizes QLora methods for efficient and effective tuning, optimizing its performance for its intended use cases.
- Context Length: Supports a context window of 8192 tokens, allowing for processing longer inputs and maintaining conversational coherence.
- Development Status: Currently an alpha version and under active construction, indicating ongoing development and potential for future enhancements.
Performance Insights
Preliminary evaluations on the Open LLM Leaderboard show an average score of 15.18. Specific metrics include:
- IFEval (0-Shot): 41.89
- BBH (3-Shot): 16.88
- MMLU-PRO (5-shot): 18.16
These scores provide an initial indication of its capabilities across various benchmarks, with a particular focus on its performance in French professional contexts.
Ideal Use Cases
This model is particularly suitable for developers and organizations requiring a specialized language model for:
- French-centric professional applications: Tasks that demand nuanced understanding and generation of French text in professional settings.
- Early-stage integration: For those interested in testing and providing feedback on an evolving, domain-specific French LLM.