A drop‑in, all‑in‑one gesture input system for Unity. Nova wraps hand‑landmark detection (via MediaPipe) and a flexible gesture recognizer into Unity‑friendly components, prefabs, and events. This way developers can focus in the important aspect of their application, not troubleshooting multiple libraries and their compatibilities.
Nova is a Unity package that turns a webcam (or video feed) into high‑level gesture events. Under the hood we use MediaPipe to generate hand landmarks, then provide:
- Ready‑to‑use prefabs for camera/processing/visualization
- Configurable Gestures and Gesture Chains you can author in the Editor
- Unity Events you can hook into UI, input systems, or scripts
- Sample scenes that demonstrate common patterns (menu navigation, character control, racing)
Nova’s goal is to be package‑level plug‑and‑play, import it and build.
- All‑in‑one Unity package. No extra glue code or native setup.
- Editor‑first workflow. Create gestures and gesture chains as assets; tweak settings live.
- Drop‑in prefabs. Get to a working prototype in minutes.
- Battle‑tested samples. Two scenes show practical interaction patterns.
Looking for installation, platform support, tutorials, or troubleshooting? All of that lives in the Wiki. 👉 Read the Wiki: https://github.com/GYOUDNova/Nova/wiki (or use the repo’s Wiki tab)
Main Screen
In‑scene gesture control
All samples are included under Assets/Samples~:
-
SampleMenu – A kiosk‑style UI you fully navigate with hand gestures.
-
Rollaball – Classic Unity “roll a ball” tutorial reimagined with gesture input.
- Install Nova → see the Wiki’s Installation page.
- Create a Gesture or a Gesture Chain → see the Wiki’s authoring guides.
- Troubleshooting (camera, performance, platforms) → see the Wiki’s FAQ.
📘 Wiki: https://github.com/GYOUDNova/Nova/wiki
Authors
- Hayden Auterhoff
- Omar Nunez
- Ryan Samii
- Talon Ernst
Credits
- Built on the MediaPipe Unity Plugin for hand‑landmark detection.
- Thanks to the Unity community samples that inspired our scenes.
See LICENSE in this repository.