projectBEA

BeaCraft: Technical Bridge for Autonomous Agents

BeaCraft is a Fabric mod that functions as a WebSocket interface between Minecraft and external AI systems. It provides the necessary infrastructure for LLM-based agents to perceive the game world and execute complex tasks programmatically.

Core Functionalities

• State Broadcasting: Periodically transmits JSON packets containing player health, hunger, coordinates, inventory, and surrounding block/entity data.
• Action Execution: Maps external command packets to in-game behaviors including pathfinding, mining, crafting, and combat.
• Asynchronous Feedback: Returns status updates (IDLE, FINISHED, INTERRUPTED) to the agent, allowing for reactive logic and error handling.
• Vision & Communication: Supports remote screenshot requests for visual context processing and bridges the in-game chat for social interaction.

Technical Architecture

• Protocol: WebSocket (default ws://localhost:8080).
• Format: Standardized JSON envelopes for both state updates and action requests.
• Compatibility: Specifically designed for integration with Python-based AI frameworks like ProjectBEA.

Implementation Requirements

• Loader: Fabric Loader.
• Configuration: Managed via config.json to define server ports and update frequencies.
• Environment: Operates as a local bridge, requiring the external agent to run on a reachable network address.