Skip to content

Implement Mediapipe landmark detection in the client side #6

@kevinjosethomas

Description

@kevinjosethomas

Description

The current interface identifies Mediapipe hand landmarks on the server side. The webcam is fetched through the server, and served to the client through an iframe. This approach will lead to technical debt in the future and was initially only implemented for fast-tracked development. I did have a functioning approach with WebRTC but chose to not continue that approach because it required a WiFi connection to work.

Ideally, the React client will identify the Mediapipe landmarks in the client side to reduce the load on the server and also so anyone in the world can access the interface from their home.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestreceptiveASL → English technology

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions