Overview

MaziyarPanahi/Llama-3-8B-Instruct-v0.4 is an instruction-tuned large language model built upon Meta's Llama-3-8B-Instruct base model. This 8 billion parameter model is designed to follow instructions effectively and engage in conversational AI, making it a versatile tool for developers.

Key Characteristics

• Base Model: Derived from meta-llama/Meta-Llama-3-8B-Instruct.
• Prompt Template: Employs the ChatML format for structured input and output, facilitating clear communication with the model.
• Quantized Versions: GGUF quantized versions are available for optimized deployment and inference, accessible at MaziyarPanahi/Llama-3-8B-Instruct-v0.4-GGUF.

Usage

This model can be readily integrated into applications using the Hugging Face transformers library. It supports standard text generation pipelines and includes specific eos_token_id handling for the ChatML format, ensuring proper response termination. Developers can leverage its instruction-following capabilities for tasks ranging from content generation to interactive chatbots.