Skip to content

Controlling OS and applications with hand motion gestures based on profile of which application is open. Each application can be assigned a profile to repurpose all gestures for that specific app.

License

Notifications You must be signed in to change notification settings

rishabhpatel9/Gesture-Control

Repository files navigation

Gesture-Recognition

This Project is based on the project RT_GestureRecognition by @fabiopk and has been developed further in Ubuntu. Some libraries are Ubuntu specific and might not work in windows. Some of the functioning of the original model has been altered for the purposes of this project. You can check out this video to see a working model and another video that shows another possible application of this project.

Getting the demo to work:

Clone the repository. You might need to install some libs such as:

  • PyTorch
  • OpenCV2
  • Numpy
  • Pandas
  • Torchvision
  • PyautoGUI

Run demo.py

Press Q to stop.

TO DO:

  • Repurpose commands for more vital tasks
  • Build the project with libraries that work with windows.

Special thanks to @fabiopk for providing the model used here.

Citation

Please cite the following article if you use this code or pre-trained models:

@ARTICLE{9085286,
  author={F. {Brandolt Baldissera} and F. L. {Vargas}},
  journal={IEEE Latin America Transactions}, 
  title={A Light Implementation of a 3D Convolutional Network for Online Gesture Recognition}, 
  year={2020},
  volume={18},
  number={02},
  pages={319-326},
  doi={10.1109/TLA.2020.9085286}}

About

Controlling OS and applications with hand motion gestures based on profile of which application is open. Each application can be assigned a profile to repurpose all gestures for that specific app.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published