Overview

jan-hq/stealth-v1.3 is a 7 billion parameter language model developed by Jan, designed to be run efficiently on local machines. It supports an 8192-token context length, making it suitable for handling moderately long conversations and documents. The model is integrated with Jan Desktop, an open-source, offline-first alternative to ChatGPT, ensuring user privacy and data control.

Key Capabilities

• General-purpose AI: Achieves an average score of 71.12 on the Open LLM Leaderboard, indicating strong performance across diverse tasks.
• Reasoning: Scores 67.49 on the AI2 Reasoning Challenge and 71.57 on GSM8k, demonstrating capabilities in logical and mathematical reasoning.
• Language Understanding: Performs well on HellaSwag (86.74) and Winogrande (80.74), suggesting good common sense and language comprehension.
• Offline Operation: Can be run entirely offline via Jan Desktop, ensuring conversations remain confidential and on the user's machine.
• OpenAI Compatible: Provides a local server with OpenAI-compatible endpoints for easy integration into existing workflows.

Good For

• Developers and users seeking a private, offline-capable AI assistant.
• Applications requiring a balance of performance and local execution.
• General conversational AI tasks and reasoning-based queries.