Among the countless projects that challenge conventional norms and offer innovative approaches to games and game development, hand gesture-based systems definitely hold their own. This fact was recently reaffirmed by programmer and ML enthusiast Ayaan Khan.
On LinkedIn, Ayaan shared an impressive setup he devised during his high school days. With this setup, you will be able to play the Racing Her game by simply waving your finger in the air in front of your webcam and making various hand gestures. Inspired by the idea of combining technology and gaming, the system allows users to drive a virtual car by detecting their fingers on camera, delivering a truly unique gaming experience.
The demo Ayaan shared showed how the system can be used to play EA’s 2017 racing game, Need for Speed Payback. Although the developers refrained from revealing the inner workings of the system, He hinted that it primarily relies on Python, OpenCV, and MediaPipe, and offered a tip for aspiring developers interested in replicating the setup. Click this link to see Ayaan’s original post.