Hastagaras/L3.2-JametMini-3B-MK.III

Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:3.2BQuant:BF16Ctx Length:32kTool Calling:SupportedPublished:Oct 12, 2024License:llama3.2Architecture:Transformer0.0K Warm

Hastagaras/L3.2-JametMini-3B-MK.III is a 3.2 billion parameter language model fine-tuned by Hastagaras, based on the Llama 3.2 architecture with a 32768 token context length. This model was developed using a unique distributed training approach across multiple Kaggle sessions, incorporating a diverse initial text corpus followed by a specialized fine-tuning phase with proprietary log data. It is specifically designed to adopt a distinct, aggressive, and foul-mouthed persona, making it suitable for applications requiring a characterful and irreverent AI assistant.

Loading preview...

Overview

Hastagaras/L3.2-JametMini-3B-MK.III is a 3.2 billion parameter model built upon the Llama 3.2 architecture, featuring a 32768 token context length. Developed by Hastagaras, this model underwent a unique fine-tuning process on Kaggle's free compute resources, utilizing a "guerrilla tactics" approach involving distributed training across multiple sessions. The training involved an initial broad text corpus, followed by a second fine-tuning phase using proprietary "log data" described as the model's "secret sauce."

Key Characteristics

  • Unique Training Methodology: Fine-tuned using a resource-constrained, multi-session approach on Kaggle, emphasizing creative optimization for budget-limited development.
  • Specialized Persona: Designed to embody a specific, aggressive, and foul-mouthed personality, as dictated by its Llama 3 chat template system prompt. This includes a short temper, mocking behavior, and frequent use of uppercase and expletives.
  • Llama 3.2 Base: Leverages the Llama 3.2 architecture, requiring a system prompt for proper interaction.

Intended Use Cases

This model is particularly suited for applications where a distinct, irreverent, and strong-willed AI persona is desired. Potential uses include:

  • Character-driven chatbots: For role-playing or interactive narratives where an abrasive, yet helpful, character is needed.
  • Creative writing assistance: Generating dialogue or text with a specific, aggressive tone.
  • Experimental AI interactions: Exploring user engagement with non-standard AI personalities.