Inkbot-13b-4k: Structured Conversational AI

Inkbot-13b-4k is a 13 billion parameter conversational AI model developed by Tostino, built for interpreting and responding to structured prompts. It is designed to provide accurate and meaningful interactions by leveraging a unique structured prompt system that allows for dynamic dialogues based on context, metadata, and user input. The model supports a 4096 token context length.

Key Capabilities & Features

• Structured Prompt System: Utilizes specific <#tag#> formats for meta-data, system instructions, chat history, and user context, enabling precise control over interactions.
• RAG-Type Query Excellence: Excels at answering queries from provided context and can temporarily override its memory with user_context.
• Token Efficiency: Designed to be functional and less verbose, avoiding superfluous language to conserve tokens.
• Diverse Task Options: Supports specialized tasks including general queries, knowledge_graph extraction, question_answer, reasoning, translation, summarization, and creative_writing.

Good For

• Applications requiring precise control over AI responses through structured inputs.
• Retrieval-Augmented Generation (RAG) scenarios where contextual information is paramount.
• Developers needing a model that can perform specific functions like data extraction, summarization, or translation with explicit guidance.
• Use cases where token efficiency and direct, less chatty responses are preferred.