umiyuki/Umievo-itr012-Gleipnir-7B

TEXT GENERATIONConcurrency Cost:1Model Size:7BQuant:FP8Ctx Length:8kPublished:May 29, 2024License:apache-2.0Architecture:Transformer0.0K Open Weights Cold

umiyuki/Umievo-itr012-Gleipnir-7B is a 7 billion parameter Japanese language model created by umiyuki through an evolutionary merge of four powerful Japanese models: Japanese-Starling-ChatV-7B, Ninja-v1-RP-expressive-v2, Vecteus-v1, and Japanese-Chat-Umievo-itr004-7b. This model is specifically designed for Japanese language tasks, achieving an average score of 3.91 on the ElyzaTasks100 benchmark, making it suitable for applications requiring robust Japanese language understanding and generation.

Loading preview...

Overview

umiyuki/Umievo-itr012-Gleipnir-7B is a 7 billion parameter language model developed by umiyuki. It is the result of an evolutionary merge, utilizing an evolutionary algorithm to combine four distinct Japanese models: Japanese-Starling-ChatV-7B, Ninja-v1-RP-expressive-v2, Vecteus-v1, and Japanese-Chat-Umievo-itr004-7b. This merging process, facilitated by mergekit using a linear method, aims to leverage the strengths of its constituent models to enhance overall performance in Japanese language tasks.

Key Capabilities

  • Japanese Language Proficiency: Specifically engineered for Japanese, integrating multiple specialized Japanese models.
  • Benchmark Performance: Achieved an average score of 3.91 on the ElyzaTasks100 benchmark, evaluated via Llama3-70B.
  • Evolutionary Merging: Utilizes an evolutionary algorithm for model merging, suggesting an optimized combination of its base models.

Good For

  • Applications requiring strong performance in Japanese language understanding and generation.
  • Developers looking for a specialized Japanese LLM built from a combination of established models.
  • Tasks that benefit from a model fine-tuned for Japanese conversational and instructional contexts.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p