usermma/DeepHat-V1-7B-Heretic-Abliterated-mlx-fp16

TEXT GENERATIONPricing:Input $0.4 / Cached $0.08 / Output $0.8Concurrent Unit Cost:1Model Size:7.6BQuant:FP8Context Size:32kTool Calling:SupportedPublished:Jul 10, 2026Architecture:Transformer Featherless Exclusive Cold

The usermma/DeepHat-V1-7B-Heretic-Abliterated-mlx-fp16 is a 7.6 billion parameter language model, converted by usermma to the MLX format for optimized performance on Apple silicon. This model is an MLX-optimized version of the DeepHat-V1-7B-Heretic-Abliterated model, designed for efficient inference. It provides a readily deployable solution for applications requiring a 7B class model within the MLX ecosystem.

Loading preview...

Model Overview

The usermma/DeepHat-V1-7B-Heretic-Abliterated-mlx-fp16 is a 7.6 billion parameter language model, specifically converted for the MLX framework. This model is derived from the usermma/DeepHat-V1-7B-Heretic-Abliterated base model and has been optimized for efficient inference on Apple silicon using mlx-lm version 0.31.2.

Key Characteristics

  • MLX Format: Optimized for performance within the MLX ecosystem, enabling efficient execution on compatible hardware.
  • Parameter Count: Features 7.6 billion parameters, offering a balance between capability and computational requirements.
  • Context Length: Supports a context length of 32768 tokens, suitable for processing longer inputs and generating more coherent responses.

Usage

This model is designed for direct integration with the mlx-lm library. Developers can easily load and utilize the model for text generation tasks, including chat-based interactions, by leveraging the provided mlx_lm.load and mlx_lm.generate functions. The conversion ensures compatibility and streamlined deployment for MLX-based applications.

Finetunes
1 models