jiweon70/marketingai_panda-v4
The jiweon70/marketingai_panda-v4 is a 2.6 billion parameter language model, fine-tuned and converted to GGUF format. This model leverages the Gemma 2B architecture and is optimized for efficient deployment and inference, particularly with tools like Unsloth and Ollama. Its primary application is in general text generation tasks, offering a compact yet capable solution for various language processing needs.
Loading preview...
Overview
The jiweon70/marketingai_panda-v4 is a 2.6 billion parameter language model, based on the Gemma 2B architecture. It has been fine-tuned and converted into the GGUF format, making it suitable for local deployment and efficient inference using tools like llama-cli and Ollama.
Key Characteristics
- Architecture: Based on the Gemma 2B model.
- Parameter Count: 2.6 billion parameters.
- Context Length: Supports an 8192-token context window.
- Format: Provided in GGUF format, specifically
gemma-2-2b-it.Q4_K_M.gguf. - Optimization: Fine-tuned and converted using Unsloth, which facilitated a 2x faster training process.
- Deployment: Includes an Ollama Modelfile for streamlined integration and usage.
Usage Considerations
This model is designed for general text generation and understanding tasks. Its GGUF format and Ollama compatibility make it accessible for developers looking for a compact and efficient LLM solution. The model's BOS token behavior has been adjusted for GGUF compatibility, ensuring proper function within supported inference engines.