SicariusSicariiStuff/Zion_Alpha

TEXT GENERATIONConcurrent Unit Cost:1Model Size:7BQuant:FP8Context Size:8kTool Calling:SupportedPublished:May 19, 2024License:apache-2.0Architecture:Transformer0.0K Open Weights Featherless Exclusive Cold

Zion_Alpha, developed by SicariusSicariiStuff, is a 7 billion parameter language model based on the Mistral architecture, specifically designed and optimized for Hebrew language understanding and generation. It is notable for being the first model explicitly focused on Hebrew comprehension, demonstrating strong out-of-the-box translation capabilities and achieving the highest SNLI score in Hebrew among open-source models. Its primary use case is advanced Hebrew natural language processing tasks, including translation and content generation.

Loading preview...

Zion_Alpha: The First Dedicated Hebrew LLM

Zion_Alpha, developed by SicariusSicariiStuff, is a 7 billion parameter language model built upon the Mistral 7B architecture. It stands out as the first model specifically designed for deep understanding and comprehension of the Hebrew language, rather than merely being fine-tuned for specific tasks. This focus allows it to perform exceptionally well in Hebrew NLP, including translation, where it has shown to outperform general-purpose models like GPT-4 in initial tests.

Key Capabilities

  • Native Hebrew Comprehension: Engineered from the ground up to understand and generate Hebrew text effectively.
  • Superior Translation: Demonstrates strong out-of-the-box translation capabilities between English and Hebrew.
  • Leading Hebrew Benchmarks: Achieved the highest SNLI score in the world among open-source models in Hebrew (84.05 score) as of June 2024.
  • Mistral-based Architecture: Leverages the efficient and robust Mistral 7B foundation.

Good for

  • Developers and researchers working on Hebrew-centric applications.
  • Translation services requiring high accuracy for Hebrew content.
  • Generating natural and coherent text in Hebrew.
  • Exploring advanced NLP tasks in the Hebrew language where existing models fall short.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p