open-unlearning/unlearn_tofu_Llama-3.2-1B-Instruct_forget10_IdkDPO_lr2e-05_beta0.1_alpha1_epoch10

Warm
Public
1B
BF16
32768
Hugging Face
Overview

Overview

This model, unlearn_tofu_Llama-3.2-1B-Instruct_forget10_IdkDPO_lr2e-05_beta0.1_alpha1_epoch10, is a specialized variant of the Llama-3.2-1B-Instruct architecture developed by open-unlearning. Its primary focus is on the concept of "unlearning," where the model is trained to forget specific information it previously learned.

Key Capabilities

  • Targeted Unlearning: Designed to demonstrate the ability to remove specific data points or knowledge from its learned parameters.
  • Research into Model Privacy: Serves as a tool for exploring techniques related to data privacy and the right to be forgotten in large language models.
  • Instruction-following Base: Built upon an instruction-tuned Llama model, retaining general instruction-following abilities while incorporating unlearning.

Good For

  • Academic Research: Ideal for researchers studying machine unlearning, catastrophic forgetting, and data privacy in LLMs.
  • Experimentation: Useful for developers and researchers looking to experiment with and understand the effects of unlearning algorithms.
  • Demonstrating Unlearning: Can be used to showcase the practical application of unlearning techniques on a pre-trained model.