Model Overview

This model, llama-3.2-3b-psychotherapy-cbt, is a 3.2 billion parameter language model based on the Llama-3.2 architecture. It has been specifically fine-tuned for applications within psychotherapy and Cognitive Behavioral Therapy (CBT) contexts. The model supports a substantial context length of 32768 tokens, enabling it to handle detailed and lengthy therapeutic conversations.

Key Characteristics

• Specialized Fine-tuning: Optimized for psychotherapy and CBT-related tasks.
• Architecture: Built upon the Llama-3.2 base model.
• Parameter Count: Features 3.2 billion parameters.
• Context Length: Supports a 32768 token context window.
• GGUF Format: Provided in GGUF format, facilitating deployment with tools like llama.cpp and Ollama.
• Unsloth Integration: Fine-tuned and converted using Unsloth, which can offer faster training and conversion.

Use Cases

This model is particularly well-suited for:

• Developing AI assistants for therapeutic support.
• Generating or analyzing dialogue in CBT scenarios.
• Research into AI applications in mental health.
• Educational tools for psychotherapy students.

It is designed to provide more relevant and nuanced responses in therapeutic contexts compared to general-purpose language models.