Sentdex/WSB-GPT-7B: A WallStreetBets-Themed Chatbot

Sentdex/WSB-GPT-7B is a Llama 2 7B Chat model, developed by Sentdex, that has been fine-tuned using QLoRA. The training data consists of comments and responses from the r/wallstreetbets subreddit, specifically from the 2017-2018 period. This fine-tuning imbues the model with the characteristic language and tone of that community.

Key Capabilities

• Character-driven Chatbot: Designed to generate responses reflecting the unique, often irreverent and aggressive, style of the WallStreetBets subreddit.
• Instruction-tuned: Follows a specific prompt format (### Comment:\n[parent comment text]\n\n### REPLY:\n[bot's reply]\n\n### END.) for generating conversational output.
• Llama 2 Base: Benefits from the foundational capabilities of the Llama 2 7B Chat model.

Intended Use and Limitations

The model's primary purpose is for fun and exploration of QLoRA fine-tuning. It is explicitly noted that the model can be offensive and abrasive, as it incorporates language popular in the WSB subreddit during its training period, which may include terms now considered inappropriate. Users should be aware of this bias and its potential for generating controversial content. It is not intended for general-purpose applications where polite or neutral language is required. The model was trained on a Lambda Labs 1x H100 80GB GPU instance.