Nano_Imp_1B: The World's First 1B-Parameter Roleplay Model
SicariusSicariiStuff's Nano_Imp_1B is a groundbreaking 1 billion parameter model, notable for being the first and only fully coherent roleplay (RP) model at this size. Historically, coherent RP was thought to require at least 3 billion parameters, but Nano_Imp_1B challenges this, making advanced local AI accessible to users with limited hardware, including older CPUs.
Key Capabilities
- Coherent Roleplay: Despite its small size, the model demonstrates surprising coherence in roleplaying scenarios.
- Hardware Accessibility: Designed to run efficiently on a wide range of devices, including older CPUs, making it highly accessible.
- CAI-style Responses: Generates short responses, typically 1-2 paragraphs, suitable for interactive roleplay.
- Character Card Adherence: Shows good ability to follow character card instructions, especially with recommended generation settings.
- Basic General Tasks: Capable of basic creative writing and general tasks in addition to its primary RP focus.
Good For
- Users seeking a highly accessible, locally runnable roleplay model.
- Creative writing applications requiring short, character-consistent outputs.
- Experimenting with small, yet capable, language models for interactive storytelling.
The model is available in various quantizations, including FP16, GGUF, GPTQ, EXL3, and specialized FP8 and Mobile (ARM) formats, further enhancing its versatility and accessibility.