Vibe Coding XR: Accelerating A... Note

Vibe Coding XR: Accelerating AI + XR prototyping with XR Blocks and Gemini

The document introduces "Vibe Coding XR," a new workflow that uses LLMs like Gemini to translate natural language into functional XR applications. This system allows users to create physics-aware Android XR experiences in under 60 seconds, bypassing the complexities of traditional XR prototyping. It leverages XR Blocks, a web-based framework, to handle spatial logic and make XR development more accessible to a wider audience. Users describe their desired XR experience with a prompt, and Gemini designs and implements it, including interactive elements. A simulator facilitates testing on desktop before deployment to Android XR. Various application scenarios are demonstrated, showcasing the system's versatility across educational and entertainment fields. A preliminary evaluation, VCXR60, using different prompts was conducted and the results are then presented. The project aims to enable rapid prototyping of XR experiences by focusing on creative output over technical expertise. The work is open-source.