L3.1-70b-MeowMix by KaraKaraWitch is a 70 billion parameter merged language model based on the Llama 3.1 architecture. This model is a merge of several Llama 3.1-70B variants, including Tess-3, EZO-1.1-it, Chinese-Chat, and Korean-sft-dpo models, created using the ties merge method. While it functions well for English language tasks, it is explicitly noted as a failed attempt for CJK (Chinese, Japanese, Korean) languages, performing poorly in those contexts.
No reviews yet. Be the first to review!