← Back to the issue
05 Google Research · 25 August 2026 ([research.google](https://research.google/blog/agenthands-generating-interactive-hand-gestures-for-spatially-grounded-agent-conversations-in-xr/))

Interfaces are learning to point, not just speak

Google Research’s AgentHands prototype explores conversational agents that use synchronized hand gestures and spatial references in XR.

Google Research AgentHands workflow diagram for spatial XR gestures

The next interface may explain through movement as much as language.

The Story

Google Research’s AgentHands is an XR prototype that maps an agent’s reasoning into synchronized, spatially grounded hand gestures. It can reference tagged objects, demonstrate actions and place gestures within the user’s physical environment. ([research.google](https://research.google/blog/agenthands-generating-interactive-hand-gestures-for-spatially-grounded-agent-conversations-in-xr/))

For designers, the interesting shift is from conversational UI to embodied direction. A system that points, traces, highlights or demonstrates has a richer visual language—and a much higher need for legibility, timing and restraint. ([research.google](https://research.google/blog/agenthands-generating-interactive-hand-gestures-for-spatially-grounded-agent-conversations-in-xr/))

Studio Wensday angle: start studying gesture as a design primitive. Even outside XR, micro-animations, cursor behaviour and guided transitions can make a digital product feel more instructional and human.

Studio Wensday Angle

Design motion and spatial cues as meaning, not decoration.