hkust-nlp/deita-complexity-scorer

The hkust-nlp/deita-complexity-scorer is a 7 billion parameter model developed by HKUST NLP, fine-tuned from Llama-1-13b-hf, designed to automatically annotate the instruction complexity of Supervised Fine-Tuning (SFT) data. This model specializes in providing a numerical complexity score for user queries, making it a crucial tool for automatic data selection in Large Language Model instruction tuning. Its primary use case is to streamline the process of curating high-quality datasets by identifying and scoring the complexity of instructions.