How does Gest-XR's VR Music Classroom work in an educational setting?

Students put on a VR headset and enter a 3D stage where hand gestures trigger virtual instruments. A teacher dashboard manages sessions, groups, and recordings in real time from any browser.

Can Gest-XR support live audiences without headsets?

Yes. The performer uses a headset while the audience experiences the spatial visuals on large screens with spatial audio. A WebRTC stream can also deliver the XR experience to remote audiences.

Does Gest-XR's music therapy mode track patient progress?

Yes. The therapist dashboard records gesture range of motion, reaction latency, and session engagement over time. Data exports to CSV and FHIR-compatible JSON for integration with clinical records systems.

Gest-XR's Museum Installation converts gallery spaces into gesture-driven sound art experiences. Visitors interact with virtual sound objects using natural hand movements—no headset required in pass-through mode. Runs 8+ hours unattended on a single workstation.

culture

Museum XR Installation

Q: Can the Gest-XR museum installation run without VR headsets?

Yes. Using camera-based hand tracking with pass-through mode, visitors interact with overlaid spatial audio-visuals using bare hands. Optionally, untethered headsets (Meta Quest 3) provide full immersion for deeper engagement.

Turn galleries and cultural spaces into interactive sound-and-motion installations. Visitors create music through movement, making the artwork a participatory, living performance.

◈ Meta Quest 3◈ Depth Camera◈ Large Display⚡ <18ms

Technical specifications

Latency: < 18 ms
Render FPS: 60 FPS
Compatible hardware: Meta Quest 3, Depth Camera, Large Display
SDKs: WebXR, MediaPipe Hands
Networking: WebSocket
Data formats: glTF 2.0, OSC

FAQ

Can the Gest-XR museum installation run without VR headsets?+

Yes. Using camera-based hand tracking with pass-through mode, visitors interact with overlaid spatial audio-visuals using bare hands. Optionally, untethered headsets (Meta Quest 3) provide full immersion for deeper engagement.

Research

Expert-authored technical whitepapers

2025

Sub-20ms Spatial Audio in WebXR: Architecture & Benchmark Methodology

Technical architecture and benchmark results for achieving spatial audio latency below 20ms across WebXR, WebRTC, and native OpenXR runtimes.

By Luca FerrettiGest-XR Technical Research

Read whitepaper →

Ready to feel music from within?

Gest-XR opens contemporary creation to performers, educators, venues, and curious listeners alike. Reach out for demos, partnerships, or early access.

✉ hello@gest-xr.com ↑ Back to top