shamilmohammedi/Azhari_Model_v0.4_Academic

TEXT GENERATIONConcurrency Cost:1Model Size:7.6BQuant:FP8Ctx Length:32kPublished:Mar 28, 2026Architecture:Transformer Cold

The Azhari Model v0.4 Academic by shamilmohammedi is a 7.6 billion parameter Llama-3-8B variant, fine-tuned on academic Sharia datasets from Al-Maktaba Al-Shamila. This research prototype, with a 32768 token context length, focuses on evaluating the effectiveness of combining Fine-Tuning (FT) and Retrieval-Augmented Generation (RAG) to reduce hallucinations in Islamic Jurisprudence contexts. It is specifically designed for academic benchmarking and AI research in specialized religious domains.

Loading preview...

Azhari Model v0.4 Academic: Specialized Islamic Jurisprudence Research Model

This model, developed by shamilmohammedi, is an experimental research prototype based on the Llama-3-8B architecture, fine-tuned with 7.6 billion parameters and supporting a 32768 token context length. Its core purpose is to investigate the efficacy of combining Fine-Tuning (FT) and Retrieval-Augmented Generation (RAG) in mitigating hallucinations within the domain of Islamic Jurisprudence.

Key Characteristics & Research Focus

  • Base Model: Llama-3-8B, optimized for Arabic language processing.
  • Fine-tuning Method: Utilizes QLoRA (Rank 64) via Unsloth for efficient adaptation.
  • Data Source: Specialized academic PDFs and subsets from Al-Maktaba Al-Shamila, focusing on Sharia.
  • Evaluation: Performance is assessed across 10 Sharia test cases using metrics like Semantic Similarity, BERTScore, and Perplexity to measure contextual accuracy, alignment with golden references, and model confidence.

Intended Use Cases

  • Academic Benchmarking: Ideal for researchers evaluating LLM performance in highly specialized religious or legal texts.
  • AI Research: Specifically designed for studies on hallucination reduction techniques (FT + RAG) in domain-specific applications.
  • Islamic Jurisprudence Studies: Provides a platform for exploring AI capabilities and limitations within Sharia contexts.

Important Disclaimer

This model is a research prototype and is not intended for practical application as a licensed Mufti or for providing religious rulings. Its use is strictly limited to academic and AI research purposes.