GitHub - collidingScopes/3d-model-playground: Control 3D models using hand gestures and voice commands in real-time. Threejs / mediapipe computer vision
3D Model Playground
Control 3D models using hand gestures and voice commands in real-time.
An interactive web app built with threejs, mediapipe computer vision, web speech API, and rosebud AI.
Say "drag", "rotate", "scale", or "animate" to change the interaction mode
Pinch fingers to control the 3D model
Drag/drop a new 3D model onto the page to import it (GLTF format only for now)
Video | Live Demo
Requirements
Modern web browser with WebGL support
Camera / microphone access
Technologies
Three....
Read more at github.com