AXCXEPT/EZO-Humanities-9B-gemma-2-it

TEXT GENERATIONConcurrency Cost:1Model Size:9BQuant:FP8Ctx Length:16kPublished:Jul 9, 2024License:gemmaArchitecture:Transformer0.0K Cold

AXCXEPT/EZO-Humanities-9B-gemma-2-it is a 9 billion parameter language model based on Gemma-2-9B-it, specifically fine-tuned by AXCXEPT for enhanced performance in Humanities-related tasks. It excels in areas such as literature, philosophy, history, and cultural studies, while maintaining strong Japanese language processing capabilities. The model supports a 16384 token context length and is optimized to provide nuanced responses in academic and cultural inquiries.

Loading preview...

Model Overview

AXCXEPT/EZO-Humanities-9B-gemma-2-it is a 9 billion parameter model built upon the Gemma-2-9B-it architecture. It has undergone specialized tuning to significantly improve its performance across various Humanities disciplines.

Key Capabilities

  • Humanities Specialization: Optimized for tasks in literature, philosophy, history, and cultural studies, providing deeper insights and nuanced responses.
  • Multilingual Proficiency: While primarily focused on enhancing Japanese language processing, its training approach allows for applicability to a wide range of global inquiries.
  • Instruction Tuning: Utilizes a plain instruction tuning method with high-quality data extracted from Japanese Wikipedia and FineWeb, enhancing its ability to understand and generate exemplary responses.

Training Details

The model was trained using high-quality instruction data derived from Japanese Wikipedia and FineWeb. This innovative training approach, including pre-instruction training, aims to improve performance across various languages and domains, making it suitable for global use despite its Japanese data focus.

Intended Use

This model is provided for research and development purposes only and should be considered an experimental prototype. It is not intended for commercial use or deployment in mission-critical environments. Users assume all responsibility for its use and performance.