Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement Mediapipe landmark detection in the client side #6

Open
kevinjosethomas opened this issue May 30, 2024 · 0 comments
Open
Labels
enhancement New feature or request receptive ASL → English technology

Comments

@kevinjosethomas
Copy link
Owner

Description

The current interface identifies Mediapipe hand landmarks on the server side. The webcam is fetched through the server, and served to the client through an iframe. This approach will lead to technical debt in the future and was initially only implemented for fast-tracked development. I did have a functioning approach with WebRTC but chose to not continue that approach because it required a WiFi connection to work.

Ideally, the React client will identify the Mediapipe landmarks in the client side to reduce the load on the server and also so anyone in the world can access the interface from their home.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request receptive ASL → English technology
Projects
None yet
Development

No branches or pull requests

1 participant