How does Gest-XR's VR Music Classroom work in an educational setting?

Students put on a VR headset and enter a 3D stage where hand gestures trigger virtual instruments. A teacher dashboard manages sessions, groups, and recordings in real time from any browser.

Does Gest-XR's music therapy mode track patient progress?

Yes. The therapist dashboard records gesture range of motion, reaction latency, and session engagement over time. Data exports to CSV and FHIR-compatible JSON for integration with clinical records systems.

Can the Gest-XR museum installation run without VR headsets?

Yes. Using camera-based hand tracking with pass-through mode, visitors interact with overlaid spatial audio-visuals using bare hands. Optionally, untethered headsets (Meta Quest 3) provide full immersion for deeper engagement.

Gest-XR's Live Performance XR turns any venue into a hybrid spatial stage. Performers use hand-gesture-controlled virtual instruments in real time, streaming synchronised spatial audio to headsets or large displays at under 20ms latency via WebRTC.

venues

Live Performance XR

Q: Can Gest-XR support live audiences without headsets?

Yes. The performer uses a headset while the audience experiences the spatial visuals on large screens with spatial audio. A WebRTC stream can also deliver the XR experience to remote audiences.

Transform concert halls and cultural venues into hybrid XR stages. Performers play gesture-controlled instruments live while audiences experience spatial audio and visuals.

◈ Meta Quest 3◈ HTC VIVE Pro 2◈ Apple Vision Pro⚡ <20ms

Technical specifications

Latency: < 20 ms
Render FPS: 90 FPS
Compatible hardware: Meta Quest 3, HTC VIVE Pro 2, Apple Vision Pro
SDKs: WebXR, OpenXR, WebRTC
Networking: WebRTC + WebSocket
Data formats: glTF 2.0, OSC, MIDI

FAQ

Can Gest-XR support live audiences without headsets?+

Yes. The performer uses a headset while the audience experiences the spatial visuals on large screens with spatial audio. A WebRTC stream can also deliver the XR experience to remote audiences.

Research

Expert-authored technical whitepapers

2025

Sub-20ms Spatial Audio in WebXR: Architecture & Benchmark Methodology

Technical architecture and benchmark results for achieving spatial audio latency below 20ms across WebXR, WebRTC, and native OpenXR runtimes.

By Luca FerrettiGest-XR Technical Research

Read whitepaper →

Ready to feel music from within?

Gest-XR opens contemporary creation to performers, educators, venues, and curious listeners alike. Reach out for demos, partnerships, or early access.

✉ hello@gest-xr.com ↑ Back to top