Control desktop applications with camera-based gestures, no mouse or clicker required.
AirControl turns a camera into an input device for everyday desktop apps. The starting point is a phone's web camera, running in the browser, that lets you control things like advancing through a slide deck, paired with a companion Chrome extension or desktop app.
The larger goal is a general interface for camera-based control of desktop applications, redesigned to also work hands-free through Meta Ray-Ban smart glasses. The Ray-Ban Display presenter flow runs a web app on the glasses that emits slide-navigation intents to a relay, while a Chrome extension consumes those intents, drives Google Slides, and streams back speaker notes and slide state to a private HUD on the glasses.
Work in progress, actively being redesigned.
- Phone web-camera control of presentations (Chrome extension / desktop app)
- Reworked interaction model for general desktop control
- Meta Ray-Ban Display: hands-free slide control + private teleprompter HUD