Yingyaeliae/grok-oss-Apollyon-24B-heretic
Yingyaeliae/grok-oss-Apollyon-24B-heretic is a 24 billion parameter language model, based on the Grok-OSS Apollyon architecture, provided in GGUF quantizations. This model is specifically optimized for local CPU/GPU inference using `llama.cpp`. It is intended for educational, research, and technical evaluation purposes, with users assuming full responsibility for generated content. The model offers various quantization levels, with Q6_K_M and Q5_K_M recommended for balanced performance and size.
Loading preview...
Grok-OSS Apollyon 24B - GGUF Quantizations
This model, Yingyaeliae/grok-oss-Apollyon-24B-heretic, provides GGUF quantizations of the 24 billion parameter Grok-OSS Apollyon model. It is primarily designed for educational, research, and technical evaluation purposes.
Key Characteristics
- Model Size: 24 billion parameters.
- Context Length: Supports a context length of 32768 tokens.
- Format: Provided in GGUF quantizations, optimized for local CPU/GPU inference via
llama.cpp. - Quantization Options: Includes various quantization levels, with
Q6_K_MandQ5_K_Mrecommended for optimal balance between performance and file size.
Important Considerations
- Users are required to review and adhere to the original model's licensing, safety guidelines, and terms of use from the creator at c4tdr0ut/grok-oss-Apollyon-24B.
- Users bear full and sole responsibility for any content generated using this model, and the quantizer disclaims liability for misuse or harmful outputs.
Intended Use
This model is best suited for researchers and developers looking to experiment with the Grok-OSS Apollyon architecture in a locally deployable, quantized format. It facilitates technical evaluation and research into large language models on consumer hardware.