nm-testing/Qwen2-0.5B-Instruct-FP8-SkipQKV

TEXT GENERATIONConcurrency Cost:1Model Size:0.5BQuant:BF16Ctx Length:32kArchitecture:Transformer Cold

Loading preview...