Egocentric Spatial Reasoning

The ability of a system to understand and describe the spatial positions of objects relative to the user's body and perspective, rather than from a bird's-eye or absolute reference frame. For AI systems assisting blind travelers, egocentric spatial reasoning is critical — directions like "to your left" or "right there" must accurately reflect the user's orientation and position. Current multimodal AI models struggle significantly with this capability, sometimes providing directions in the wrong direction or being unable to determine an object's position relative to the user's hand or body.