Ricardo-H/BehR-WorldModel-Textworld-Llama3.1-8B

BehR-WorldModel-Textworld-Llama3.1-8B Overview

This model, developed by Ricardo-H, is an 8 billion parameter Llama-3.1-based world model tailored for the TextWorld environment. Its core function is to predict the subsequent environment observation based on an agent's interaction history and its next action. This capability allows it to serve as a text simulator for agent rollouts within TextWorld, facilitating research into agent behavior and environment interaction.

Key Capabilities & Differentiators

• Behavior-Consistent World Modeling: Unlike models that primarily focus on state consistency, BehR-WorldModel emphasizes "behavior consistency" in its predictions, as detailed in its accompanying research paper.
• Text-Based Simulation: It acts as a simulator for text-based environments, providing a crucial tool for developing and evaluating AI agents in complex textual worlds.
• Llama 3.1 Architecture: Built upon the Llama 3.1-8B base model, inheriting its causal language modeling capabilities.

Intended Use Cases

• Research on World Models: Ideal for academic and research purposes exploring the development and evaluation of world models in text-based settings.
• Agent Simulation: Useful for simulating agent interactions and rollouts within the TextWorld environment to test agent strategies and learning algorithms.

Limitations

• Evaluated exclusively on TextWorld; performance outside this specific distribution is not validated.
• Predicted observations, while plausible, may not always be factually accurate and should not be treated as ground truth.
• Inherits biases and potential failure modes from its Llama 3.1 8B base model.