Starstreak-7b-beta Overview

Starstreak-7b-beta is a 7 billion parameter language model developed by azale-ai, fine-tuned using the QLoRA technique from the HuggingFaceH4/zephyr-7b-beta base model. This specific variant, denoted by the "β" series, is designed for multilingual content generation.

Key Capabilities

• Multilingual Support: Excels in generating text in English, Indonesian, and a wide array of traditional Indonesian languages, including Achinese, Balinese, Banjar, Buginese, Gorontalo, Javanese, Maduranese, Minangkabau, Sundanese, Malay, Nias, and Tetum.
• Fine-tuning: Utilizes the QLoRA technique for efficient adaptation from its Zephyr base.
• Training Data: Trained on a combination of the graelo/wikipedia and uonlp/CulturaX datasets, enhancing its knowledge base across diverse topics and languages.

Good For

• Applications requiring text generation or understanding in Indonesian and its traditional dialects.
• Research and development in low-resource language processing, particularly for Indonesian regional languages.
• Projects needing a 7B parameter model with a focus on multilingual capabilities and efficient fine-tuning.