
A touch-free smart home prototype. A Wi-Fi camera watches your hand: finger counts switch LEDs and a buzzer, and pinch or wrist angle sets motor speed, all live on a web dashboard.
A touch-free smart home prototype. A Wi-Fi camera watches your hand: finger counts switch LEDs and a buzzer, and pinch or wrist angle sets motor speed, all live on a web dashboard. Delivered in close partnership with In-house, this engagement covered discovery, implementation, and post-launch support, with measurable outcomes tracked for 90 days after go-live.
I built a way to control real devices with nothing but hand motion, covering the full loop from camera to switch. An ESP32-CAM streams video over Wi-Fi to a Python server, where MediaPipe tracks the hand and OpenCV turns it into finger counts and rotation angles. The server drives an ESP8266 that switches LEDs and a buzzer and sets motor speed with PWM, all in real time. To keep it fast, I held one warm HTTP connection open and grouped commands into a single batch request. A Vue dashboard shows the live feed and device states.