Hugging Face Overview
Model Overview
Saxo/Linkbricks-Horizon-AI-Korean-Advanced-8B is an 8 billion parameter Korean language model developed by Yunsung Ji (Saxo), a data scientist at Linkbricks. It is built upon the Hermes-3-Llama-3.1-8B base model and underwent extensive continued pre-training (CPT), supervised fine-tuning (SFT), and Direct Preference Optimization (DPO) using 8 H100-80G GPUs.
Key Capabilities
- Multilingual Enhancement: Trained on a 10 million Korean news corpus, augmented with Korean-Chinese-English-Japanese cross-training data to improve cross-lingual understanding.
- Advanced Reasoning: Incorporates mathematical and logical judgment data to handle complex logical problems effectively.
- High-Dimensional Analysis: Optimized for in-depth analysis of customer reviews and social media posts.
- Coding and Writing: Enhanced capabilities in code generation and creative writing tasks.
- Extended Context Window: Supports a 32768-token context window for processing longer inputs.
- Tool Integration: Features support for Korean Function Call and Tool Calling, enabling interaction with external systems.
- Training Methodology: Utilizes advanced techniques like Deepspeed Stage=3, rslora, and BAdam Layer Mode for efficient fine-tuning.
Use Cases
This model is particularly well-suited for applications requiring:
- Sophisticated Korean language understanding and generation.
- Cross-lingual tasks involving Korean, Chinese, English, and Japanese.
- Complex problem-solving in mathematics and logic.
- Automated content creation and code generation.
- Integration with external tools and APIs via function calling.