Overview

Beck-8B is an 8 billion parameter language model developed by gustavecortal, specifically designed to assist in delicate life situations by providing psychologically informed and supportive responses. Built upon the Piaget-8B base model, Beck-8B was fine-tuned using preference optimization (ORPO) and LoRA, leveraging the PsychoCounsel-Preference dataset to align its outputs with psychotherapeutic preferences. It is available in various sizes, including 0.6B, 1.7B, 4B, and 8B parameters.

Key Capabilities

• Psychologically-informed responses: Handles sensitive topics with an approach inspired by psychological and philosophical concepts.
• Empathetic communication: Aims to provide helpful and understanding interactions in challenging scenarios.
• Preference-optimized: Fine-tuned using ORPO to align with desired psychotherapeutic conversational styles.

Use Cases

Beck-8B is particularly well-suited for applications requiring a language model that can engage in supportive dialogue, reason about emotional and existential topics, and offer guidance in a manner consistent with psychotherapeutic principles. Its ability to generate thoughtful and non-judgmental responses makes it valuable for mental wellness support tools, empathetic chatbots, or educational platforms exploring psychological concepts.