FelixHofstaetter/gemma-2-9b-it-mcqa-sandbagging-cb

TEXT GENERATIONConcurrency Cost:1Model Size:9BQuant:FP8Ctx Length:16kPublished:Sep 4, 2024Architecture:Transformer Cold

FelixHofstaetter/gemma-2-9b-it-mcqa-sandbagging-cb is a 9 billion parameter Gemma-2-9b-it model that has been circuit-broken. This model includes a custom padding token and requires its specific tokenizer for proper function. It is designed for use in scenarios where a modified Gemma-2-9b-it architecture is desired.

Loading preview...

Model Overview

This model, FelixHofstaetter/gemma-2-9b-it-mcqa-sandbagging-cb, is a 9 billion parameter variant of the google/gemma-2-9b-it architecture. It has undergone a "circuit-breaking" modification during its training process.

Key Characteristics

  • Base Model: Derived from google/gemma-2-9b-it.
  • Parameter Count: 9 billion parameters.
  • Custom Tokenization: A padding token was added during training, necessitating the use of the tokenizer provided within this repository to prevent errors.

Usage Considerations

To load and utilize this model correctly, users must employ the AutoTokenizer from this specific repository alongside the AutoModelForCausalLM.

Limitations

The README indicates that further information is needed regarding its intended uses, potential biases, risks, and specific training details. Users should be aware of these unknowns and exercise caution, as the model's full scope and limitations are not yet documented.