fableforge-ai/FableForge-1.5B
FableForge-1.5B is a 1.5 billion parameter generalist language model developed by fableforge-ai, designed to distill capabilities from various 'NEXUS domains' into a single model. It is provided in GGUF format with multiple quantizations, including Q4_K_M for a balance of size and quality, and IQ4_XS for low RAM environments. This model is optimized for broad applicability across different tasks, making it suitable for diverse local inference applications.
Loading preview...
FableForge-1.5B Overview
FableForge-1.5B is a 1.5 billion parameter generalist language model from fableforge-ai, designed to integrate capabilities from various 'NEXUS domains' into a single, versatile model. It is distributed in GGUF format, offering a range of quantizations to suit different hardware constraints and performance needs.
Key Capabilities & Features
- Generalist Design: Distills knowledge and capabilities from multiple domains, aiming for broad applicability.
- Optimized for Local Inference: Provided in various GGUF quantizations, making it accessible for local deployment with tools like Ollama, llama.cpp, and LM Studio.
- Quantization Options: Offers a wide selection of quantizations, from full precision (F16) to highly compressed versions like IQ2_XXS, with
Q4_K_Mrecommended for most users due to its balance of size and quality, andIQ4_XSfor low RAM scenarios. - ChatML Prompt Format: Utilizes the ChatML format for structured conversations, supporting system, user, and assistant roles.
Ideal Use Cases
- Diverse Local Applications: Suitable for developers and users looking to run a capable generalist model on consumer hardware.
- Resource-Constrained Environments: The availability of highly compressed quantizations (e.g.,
IQ4_XS,Q3_K_M) makes it viable for devices with limited RAM. - Experimentation and Prototyping: Its generalist nature and ease of deployment make it a good choice for exploring various NLP tasks.