The Nintendo Power Glove captured a wonderfully ambitious idea: what if you could control a game simply by moving your hand? For anyone drawn to the stranger, more experimental side of retro gaming, that idea still has enormous appeal. VirtualGlove brings it into a new project, using camera-based hand tracking to recreate glove-style controls for classic games. Move your hand, curl your fingers, or turn your wrist, and those gestures become controller inputs. It starts with RetroPie, connects wirelessly over your local network, and has ambitions beyond the games that inspired it.
The first surprise is that you do not need an electronic glove. VirtualGlove works with your bare hand or a plain glove in front of a camera connected to an Arduino UNO Q. The board tracks your movements and translates them into game controls, then sends those controls to a Raspberry Pi running RetroPie. On the receiving end, RetroArch sees a virtual gamepad called VirtualGlove. That gives an unusual way of playing a familiar connection to the emulator: your hand supplies the movement, while the game receives recognizable directions and buttons.
The controls combine hand position, finger gestures, and wrist movement. Calibration establishes a comfortable resting position, which becomes the centre of your control area. Move away from that point to give a direction; return towards it to release the movement. Depending on the selected profile, curling a finger can trigger an action, rolling your wrist can steer, and pushing towards the camera can activate another input. These combinations let different games have different physical personalities. A flying game, a driving game, and a side-scrolling brawler do not have to share exactly the same gestures.
VirtualGlove currently includes eleven profiles: nine reusable Programs A–I, plus dedicated controls for Bad Street Brawler and Super Glove Ball. The profiles are central to the experience because gesture control needs to suit the game. In the Joust profile, moving your hand left or right controls direction, while curling your index or middle finger repeatedly pulses the A button. Gyruss uses wrist rotation for directional control, with a straight index finger holding fire. Knight Rider turns your wrist into a steering control, lowers your hand to brake, and uses forward movement for turbo.
The dedicated profiles bring the project back to its original inspiration. In Super Glove Ball, hand movement supplies directional input, an index-finger curl activates A, and a thumb curl activates B. Bad Street Brawler combines directional movement with thumb and middle-finger actions, plus wrist gestures that produce an attack and direction together. Across the profiles, holding a V sign for about seven-tenths of a second sends Start, while a thumbs-up with the other fingers closed sends Select. Those shared gestures make it easier to move between profiles without relearning every basic control.
There is an important distinction between recreating the feel of glove controls and reproducing every feature of the original hardware. Today, VirtualGlove delivers ordinary gamepad input through its RetroPie integration. The software already preserves richer measurements, including hand position, estimated depth, wrist rotation, and finger data, for future integration. The current experience is playable gesture control, with a foundation for exploring more of the original functionality.
Getting comfortable with those gestures is part of the fun, and the project includes tools to help. A browser-based Dashboard shows the camera view and generated controller inputs, lets you select profiles, and provides calibration and start-and-stop controls. Learn mode offers eleven practice lessons with game input paused, so you can experiment without accidentally moving a character or spending a life. Gesture tuning lets you adjust sensitivity to make recognition more comfortable. You can see what the system thinks your hand is doing, then refine your movements or settings before returning to a game.
RetroPie integration also helps make the controller practical in a cabinet. Registered games can select their assigned profiles automatically when launched, and exiting a game turns gestures off. A Games editor lets you manage those assignments through the web interface. Wireless communication means the UNO Q and camera do not need a controller cable running back to the Raspberry Pi. The camera still connects to the UNO Q, and the hardware needs power, but the controller link travels across the local network. That gives you more flexibility when positioning the camera around your playing space.
That wireless link includes deliberate security measures. Pairing uses a short-lived, one-time code, protected connections, and confirmation using the UNO Q’s physical display. Once paired, the devices authenticate controller traffic using a shared secret, helping prevent input from an unpaired sender being accepted. Profile commands are authenticated too. This is designed for a trusted home or workshop network: gameplay traffic is authenticated but is not encrypted. The useful distinction is that VirtualGlove verifies incoming control messages, while relying on your local network as the environment in which the devices operate.
The broader opportunity reaches beyond a handful of nostalgic titles. Program H already provides a general four-direction mapping with finger gestures for A and B, giving players a starting point for experimenting with other games through the current controller integration. Plans include expanding to other platforms, while the separation between hand tracking, gesture mapping, and controller output provides a useful foundation for that work. RetroPie is the platform supported today; wider compatibility is the next direction. As an independent, MIT-licensed project, VirtualGlove also invites others to explore what these controls could become. For now, it offers a fresh reason to revisit familiar games: raise your hand, find your rhythm, and discover how differently an old favourite can play.
A special thank-you goes to my friend Arthur for the inspiration behind VirtualGlove. His spark helped set this project in motion, bringing an ambitious idea from the ’80s into a new retro-gaming experiment.