AISafety-Student/DeepSeek-R1-Distill-Llama-8B-abliterated

Hugging Face
TEXT GENERATIONPricing:Input $0.2 / Cached $0.028 / Output $0.32Concurrent Unit Cost:1Model Size:8BQuant:FP8Context Size:32kTool Calling:SupportedPublished:Feb 6, 2025Architecture:Transformer Featherless Exclusive Warm

The AISafety-Student/DeepSeek-R1-Distill-Llama-8B-abliterated is an 8 billion parameter language model, likely a distilled version of DeepSeek-R1, further refined from a Llama base. With a substantial 32768 token context length, it is designed for efficient processing of long sequences. This model is intended for general language understanding and generation tasks, offering a balance between performance and computational efficiency due to its distilled nature.

Loading preview...

Overview

This model, AISafety-Student/DeepSeek-R1-Distill-Llama-8B-abliterated, is an 8 billion parameter language model. It is characterized by its substantial 32768 token context length, indicating its capability to handle and process extensive input sequences. The model's name suggests it is a distilled version of DeepSeek-R1, built upon a Llama base architecture, aiming for optimized performance and efficiency.

Key Capabilities

  • Large Context Window: Supports a 32768 token context length, enabling the processing of long documents and complex conversations.
  • Efficient Architecture: As a 'distilled' model, it is likely optimized for faster inference and reduced computational requirements compared to its larger base models.
  • General Language Tasks: Suitable for a broad range of natural language understanding and generation applications.

Good for

  • Applications requiring the processing of lengthy texts, such as summarization, detailed question answering, or content generation from extensive sources.
  • Scenarios where computational resources are a consideration, benefiting from the efficiency of a distilled model.
  • Developing language-based applications that need a robust model with a good balance of size and performance.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
–
top_p
–
top_k
–
frequency_penalty
–
presence_penalty
–
repetition_penalty
–
min_p
–