farbodtavakkoli/OTel-LLM-4B-IT

Hugging Face
VISIONPricing:Input $0.05 / Output $0.1Concurrent Unit Cost:1Model Size:4.3BQuant:BF16Context Size:32kPublished:Feb 11, 2026License:apache-2.0Architecture:Transformer0.0K Open Weights Warm

OTel-LLM-4B-IT is a 4.3 billion parameter context-grounded telecom language model developed by farbodtavakkoli, fine-tuned on OTel telecommunications data. Based on google/gemma-3-4b-it, it is specifically optimized for generating accurate answers within Retrieval-Augmented Generation (RAG) pipelines for the telecommunications sector. This model demonstrates improved context-grounded correctness, enhancing performance by +3.3 to +9.4 percentage points over base checkpoints in telecom-specific tasks. It is intended for specialized telecom answer generation, leveraging a 32768 token context length.

Loading preview...

OTel-LLM-4B-IT: A Specialized Telecom Language Model

OTel-LLM-4B-IT is a 4.3 billion parameter language model developed by farbodtavakkoli, specifically fine-tuned for the telecommunications domain. Part of the OTel Family of Models, this model is built upon google/gemma-3-4b-it and has undergone full-parameter post-training using the OTel-LLM dataset.

Key Capabilities & Differentiators

  • Domain-Specific Expertise: Optimized for context-grounded answer generation within telecommunications, leveraging a dataset curated by over 100 domain experts.
  • Enhanced Correctness: Achieves a +6.5 percentage point improvement in LLM-as-judge correctness (from 66.2% to 72.7%) over its base model on held-out OTel evaluation data.
  • RAG-Optimized: Primarily designed for Retrieval-Augmented Generation (RAG) pipelines, where it processes retrieved telecom context to generate precise answers.
  • Comprehensive Training Data: Trained on a filtered corpus of 326,767 high-confidence examples derived from sources like arXiv telecom papers, 3GPP standards, GSMA documents, and O-RAN specifications.

Intended Use & Limitations

This model is intended for context-grounded telecom answer generation and should be used with retrieved telecom context. It is not optimized for unrestricted, context-free general question answering. Users should verify generated content, especially for operational, customer-facing, or regulatory applications. The model is currently English-only and text-centric, with performance evaluated on OTel-specific partitions rather than fully independent external benchmarks.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
–
frequency_penalty
presence_penalty
repetition_penalty
–
min_p
–