farbodtavakkoli/OTel-LLM-32B-IT
OTel-LLM-32B-IT is a 32 billion parameter, English-language model from the OTel Family of Models, fine-tuned on the allenai/OLMo-3-32B base model. Developed by farbodtavakkoli, it specializes in telecommunications, trained on extensive domain-specific data from academic and industry sources. This model is optimized for Retrieval-Augmented Generation (RAG) pipelines within the telecom sector, designed to generate accurate, context-grounded responses and abstain from answering when context is insufficient.
Loading preview...
OTel-LLM-32B-IT: A Specialized Telecom Language Model
OTel-LLM-32B-IT is a 32 billion parameter language model, part of the open-source OTel Family of Models, specifically designed for the global telecommunications sector. Built upon the allenai/OLMo-3-32B base model, it underwent full parameter fine-tuning using a comprehensive dataset curated by over 100 domain experts from institutions like Yale University, GSMA, NetoAI, Khalifa University, University of Leeds, and The University of Texas at Dallas.
Key Capabilities
- Telecom Domain Expertise: Highly specialized in telecommunications, trained on data including arXiv papers, 3GPP standards, GSMA documents, IETF RFCs, industry whitepapers, and O-RAN specifications.
- Retrieval-Augmented Generation (RAG) Optimized: Designed to power end-to-end RAG pipelines, working in conjunction with OTel Embedding and Reranker models to retrieve, prioritize, and generate responses grounded in telecom documentation.
- Abstention Training: Includes abstention training, meaning the model is optimized to decline to answer rather than hallucinate if it does not receive sufficient context, ensuring high factual accuracy for context-grounded generation.
Intended Use Cases
- Information Retrieval: Ideal for querying and extracting information from vast telecommunications specifications, standards, and documentation.
- Context-Grounded Response Generation: Generating accurate answers to telecom-related questions when provided with relevant context.
- Integration into RAG Systems: Can be deployed as the LLM component within a full RAG pipeline for specialized telecom applications, or used independently for specific generation tasks.