Occiglot-7B-FR-EN-Instruct Overview

Occiglot-7B-FR-EN-Instruct is a 7 billion parameter instruction-tuned language model from the Occiglot Research Collective. It is built upon the occiglot-7b-fr-en base model and has been further trained on 160 million tokens of additional multilingual and code instructions. This model is specifically designed to support English, Spanish, and code-related tasks.

Key Capabilities

• Multilingual Instruction Following: Excels at understanding and executing instructions in both English and Spanish.
• Code Generation: Capable of handling code-related prompts and generating code outputs.
• Causal Language Modeling: Functions as a causal decoder-only transformer, suitable for generative tasks.

Good For

• Applications requiring instruction-tuned responses in English and Spanish.
• Developing multilingual chatbots or assistants.
• Code generation and understanding tasks within its supported languages.
• Research into multilingual LLMs, particularly for Western languages.

Note: This model was not safety aligned and may produce problematic outputs. It represents the first release of an ongoing open research project.