enver/ayncoding-qwen2.5-coder-1.5b-instruct
AynCoding-Qwen2.5-Coder-1.5B-Instruct by Enver, AynEngine Research Initiative, and University of Prishtina is a 1.5 billion parameter instruction-tuned causal language model based on the Qwen2.5 architecture, featuring a 32768 token context length. This model is specifically designed for code synthesis, incorporating sovereign Classical Arabic Logic (Mantiq) and unique architectural elements like RootAttention and Ishtiqāq-Attention. It excels at generating code with high syntactic validity and epistemic invariant retention, making it suitable for specialized code generation tasks.
Loading preview...
AynCoding-Qwen2.5-Coder-1.5B-Instruct Overview
AynCoding-Qwen2.5-Coder-1.5B-Instruct is a 1.5 billion parameter model developed by Enver, AynEngine Research Initiative, and the University of Prishtina. This model is a specialized code synthesis LLM built on the Qwen2.5 architecture, featuring a substantial 32768 token context length. It integrates sovereign Classical Arabic Logic (Mantiq) and employs unique architectural innovations such as BPE-Free Farāhīdian/Sībawayhian tokenization, RootAttention, and Ishtiqāq-Attention.
Key Capabilities
- High Code Synthesis Performance: Achieves an impressive 78.4% on the OpenAI HumanEval (Pass@1) benchmark, indicating strong code generation abilities.
- Epistemic Invariant Retention: Demonstrates 94.2% on Epistemic Invariant Retention, highlighting its capacity to maintain logical consistency.
- AST Syntactic Validity: Boasts 98.0% AST Syntactic Validity, ensuring generated code is structurally sound.
- Specialized Architecture: Incorporates unique attention mechanisms (RootAttention, Ishtiqāq-Attention) and a distinct tokenization approach tailored for its domain.
Good For
- Specialized Code Generation: Ideal for tasks requiring code synthesis with a focus on logical consistency and syntactic correctness.
- Academic and Research Use: Permitted for academic, educational, non-commercial research, benchmarking, and cultural heritage exploration under the AynEngine & University of Prishtina Sovereign Academic License.
- Exploring Novel Architectures: Useful for researchers interested in models integrating Classical Arabic Logic and custom attention mechanisms.