Eris Floramix DPO Overview

Eris Floramix DPO is a 7 billion parameter language model from ChaoticNeutrals, built upon a unique blend of existing models. It integrates the architectures and training methodologies of both Eris Remix DPO and Flora DPO. A key aspect of its development involved further fine-tuning on the Synthetic_Soul_1k dataset, enhancing its capabilities through diverse synthetic data.

Key Capabilities

• DPO Fine-tuned: The model has undergone Direct Preference Optimization (DPO) using a specialized dataset.
• Roleplay Optimization: It is specifically fine-tuned with a DPO dataset (athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED) designed for roleplaying scenarios and Alpaca-style instruction following.
• Context Length: Supports an 8192-token context window, allowing for more extensive and coherent interactions.

Good For

• Roleplaying Applications: Excels in generating responses suitable for interactive roleplay scenarios.
• Instruction Following: Benefits from Alpaca-style data, making it proficient in understanding and executing instructions.
• Creative Text Generation: Its fine-tuning on diverse datasets suggests strong capabilities in generating varied and engaging text.