Home→About→Services→Products→Projects→Blog→Contact→
Software DevelopmentCompleted

Gestro

A touch-free smart home prototype. A Wi-Fi camera watches your hand: finger counts switch LEDs and a buzzer, and pinch or wrist angle sets motor speed, all live on a web dashboard.

ClientIn-house
Year2025
DivisionSoftware Development

About this engagement

A touch-free smart home prototype. A Wi-Fi camera watches your hand: finger counts switch LEDs and a buzzer, and pinch or wrist angle sets motor speed, all live on a web dashboard. Delivered in close partnership with In-house, this engagement covered discovery, implementation, and post-launch support, with measurable outcomes tracked for 90 days after go-live.

Overview

I built a way to control real devices with nothing but hand motion, covering the full loop from camera to switch. An ESP32-CAM streams video over Wi-Fi to a Python server, where MediaPipe tracks the hand and OpenCV turns it into finger counts and rotation angles. The server drives an ESP8266 that switches LEDs and a buzzer and sets motor speed with PWM, all in real time. To keep it fast, I held one warm HTTP connection open and grouped commands into a single batch request. A Vue dashboard shows the live feed and device states.

Highlights

  • Two ways to control. Finger counts switch devices on and off, while pinch and wrist angles from MediaPipe Hands set motor speed live through PWM.
  • No accidental triggers. A gesture must hold steady for 5 frames and pass a debounce timer before anything switches, so a passing hand does nothing.
  • Fast device response. A kept-alive urllib3 connection and a batch endpoint on the ESP8266 switch several devices in one Wi-Fi request, not four.
  • Zero-config networking. Both boards announce themselves over mDNS, and the ESP32-CAM saves Wi-Fi details in EEPROM with an access point fallback.

Technology stack

PythonFlask + Socket.IOMediaPipe HandsOpenCVVue 3 + Tailwind CSSESP32-CAM (Arduino C++)ESP8266 (Arduino C++)mDNS + HTTP over Wi-Fi

Project Visuals & Architecture

Working on something similar?Tell us about your scope, we will reply within 48 hours.
Start a conversation
← All projects