This is a hand gesture detection react app, that leverages pre-built Tensorflow.js models to classify/infer detected hand gestures. The model inference can be plugged in to app workflows, which can enable easier user interactions and in turn make the app more accessible.
The primary goal of this project is to explore libraries, Tensorflow.js framework/models, to create the pipeline of accessing user webcam feed, detect and project user gestures on a web page. Additonal features will be explored to possibly perform transfer learning with new data, within the app and test new models, to turn the app into an accessibility tool.
- React.js
- Tensorflow.js framework for Deep Learning
- Tensorflow.js pre-trained models