Luna_12B_V.3: A Versatile 12B Model for Everyday Use
Luna_12B_V.3 is a 12 billion parameter merged language model developed by OddTheGreat, designed as a non-thinking, all-around model for general use, with a particular focus on Russian (RU) language tasks. It boasts a substantial 32768 token context length, allowing for strong context attention comparable to larger models like Mistral 24B in roleplaying scenarios.
Key Capabilities & Features
- Roleplaying Excellence: The model is capable of nuanced roleplaying, including acting as an antagonist or describing potentially harmful content without encountering strong censorship or refusals.
- Assistant Functionality: Performs well as an assistant, handling formatted responses and document citation, especially with lower temperature settings (e.g., T0.2).
- Context Attention: Demonstrates strong context attention, perceiving small details like part numbers or dates, which is beneficial for both roleplaying and assistant tasks.
- Multilingual Support (RU): Excels in Russian (RU) language tasks, with extensive testing confirming its strong performance as an assistant in RU.
- Vision Capabilities: Includes vision support, though its full extent is not detailed by the developer.
Good For
- Roleplaying: Particularly suited for immersive roleplaying experiences where nuanced character interactions and handling of diverse content are desired.
- General Assistant Tasks: Effective for everyday assistant functions, including generating formatted text and citing information.
- Russian Language Applications: A strong choice for applications requiring robust performance in the Russian language.
- Resource-Conscious Deployment: As a 12B model, it offers a balance of performance and efficiency, even running on consumer-grade GPUs like the RX 6600XT or GTX 1060 6GB with offloading.
Known Limitations
- Repetition Issues: The model may exhibit repetition in very long, monotonous answers due to its strong context attention. This can potentially be mitigated with repetition penalty settings.