Overview
SymbioticLM-1B is a compact, 1 billion parameter hybrid model developed by reaperdoesntknow, part of the SymbioticAI architecture. It combines a Qwen-1B rotary transformer with a unique symbolic processing pipeline and persistent episodic memory. This design allows it to perform advanced reasoning even in resource-constrained settings, making it distinct from purely neural LLMs.
Key Capabilities
- Hybrid Architecture: Fuses a Qwen-1B transformer with symbolic processing and memory for enhanced cognitive functions.
- Memory-Augmented Reasoning: Features 2048 symbolic vectors with entropic and contextual retrieval, enabling dynamic thought evolution and memory-efficient logical processing.
- Symbolic Modules: Incorporates specialized modules like ThoughtDynamicsLNN, CrystallineProcessor (DNAConv GNN), LiquidThoughtProcessor, and HelicalDNAProcessor.
- Dream Mode: Supports symbolic simulation via a ThoughtGenerator for complex queries.
- Discrepancy Calculus Foundation: Developed under the Discrepancy Calculus (DISC) framework, which treats training singularities as structural signals for learning.
Good For
- CPU-optimized symbolic inference and embedded applications.
- Educational agents requiring memory and logical processing.
- Generating graph-based explanations and procedural plans.
- Mathematical modeling and small-scale code generation.