nm-testing/Qwen2-0.5B-Instruct-FP8-SkipQKV

Hugging Face
TEXT GENERATIONConcurrency Cost:1Model Size:0.5BQuant:BF16Ctx Length:32kArchitecture:Transformer Warm

Loading preview...