RefalMachine/ruadapt_qwen2.5_3B_ext_u48_instruct_v4 is a 3.1 billion parameter instruction-tuned language model based on the Qwen2.5 architecture, developed by RefalMachine. This model features a replaced tokenizer and continued pretraining on a Russian corpus, followed by Learned Embedding Propagation (LEP). It is specifically optimized for Russian language generation, achieving up to 60% faster generation speed for Russian texts compared to the original Qwen-2.5-3B-Instruct model.
No reviews yet. Be the first to review!