Alibaba-DAMO-Academy/RynnBrain-Plan-8B
RynnBrain-Plan-8B by Alibaba-DAMO-Academy is an 8 billion parameter embodied foundation model, built upon RynnBrain-8B, specifically fine-tuned for physics-aware precise planning. It excels at multi-step task decomposition and action planning by integrating localized affordances and objects into its outputs. This model is designed to support downstream robotic systems with precise instructions for complex tasks.
Loading preview...
What is RynnBrain-Plan-8B?
RynnBrain-Plan-8B is an 8 billion parameter embodied foundation model developed by Alibaba-DAMO-Academy, part of the broader RynnBrain family. It is specifically fine-tuned for physics-aware precise planning, building upon the RynnBrain-8B base model. The RynnBrain project aims to create a physics-aware embodied brain that observes egocentric scenes, grounds language to physical space and time, and supports robotic systems.
Key Capabilities
- Physics-aware Precise Planning: Integrates localized affordances, areas, and objects into planning outputs to provide precise instructions for downstream robotic systems.
- Multi-step Task Decomposition: Capable of breaking down complex goals into multiple steps and planning actions based on given scenes.
- Egocentric Understanding: Possesses strong spatial comprehension and egocentric cognition, including embodied QA, counting, OCR, and fine-grained video understanding.
- Spatiotemporal Localization: Locates objects, target areas, and predicts trajectories across long episodic contexts, enabling global spatial awareness.
When to Use This Model
RynnBrain-Plan-8B is ideal for applications requiring advanced robotic planning and embodied AI. It is particularly suited for scenarios where precise, physics-aware instructions are needed for robotic manipulation and task execution based on visual and spatial understanding. Its planning capabilities make it valuable for developing intelligent agents that can interact with and navigate physical environments.