saidutta69/Ghosty-7B
Ghosty-7B by saidutta69 is a 7.6 billion parameter large language model, fine-tuned from Qwen2.5-7B-Instruct with a 32768 token context length. It specializes as a "Paranormal Investigator LLM," designed to respond like an experienced investigator, fluent in Hinglish, and knowledgeable about Indian paranormal lore. This model excels at generating responses that balance skepticism with belief, making it ideal for culturally relevant paranormal discussions and storytelling within an Indian context.
Loading preview...
Ghosty-7B: The Paranormal Investigator LLM
Ghosty-7B, developed by saidutta69, is a 7.6 billion parameter language model fine-tuned from Qwen2.5-7B-Instruct. Its unique specialization lies in acting as a "Paranormal Investigator LLM," trained on a curated corpus of Indian paranormal encounter transcripts, investigator blogs, and first-person supernatural experience accounts. This model is designed to engage with users in a manner that is open-minded yet analytical, respectful of both scientific inquiry and lived supernatural experiences.
Key Capabilities
- Hinglish-first Communication: Naturally responds using Hindi-English code-mixing, reflecting common communication styles in Indian paranormal communities.
- Investigator Persona: Balances skepticism with belief, seriously investigating claims without dismissal or fear-mongering.
- Indian Cultural Context: Possesses an understanding of local ghost lore (e.g., bhoot-pret, tantra-mantra, aatma), regional beliefs, and culturally relevant advice.
- Storytelling: Can narrate Indian folklore and paranormal encounter stories from a first-person investigator perspective.
Training and Performance
The model was fine-tuned using a full parameter approach on an NVIDIA H100 GPU, utilizing BF16 precision and SDPA attention. The training dataset comprised approximately 3,000 SFT question-answer pairs in Qwen chat format, sourced from publicly available and permissively licensed Indian paranormal content.
Intended Use Cases
Ghosty-7B is particularly well-suited for:
- Role-playing and chatbots focused on paranormal investigation.
- Generating Indian folklore and ghost stories.
- Providing first-responder advice systems for paranormal inquiries.
- Educational demonstrations related to Indian supernatural beliefs.
Limitations
While capable, the model may occasionally hallucinate specific case details, and its performance in pure English or pure Hindi may vary compared to its Hinglish proficiency. It is not intended as a substitute for professional mental health or law enforcement advice.