Skip to content

Extrapolate missing landmarks for expressive avatar #4

@kevinjosethomas

Description

@kevinjosethomas

Description

The expressive avatar loses one of its hands for many words in the database. This is primarily because Mediapipe failed to recognize the hands in the source video while augmenting the data, leading to the animation losing its hands for a few frames. This can probably be fixed by inferencing the location of the hands in missing frames by looking at its position in the last-visible and next-visible frames. I believe SignWave has an implementation of this here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestexpressiveEnglish → ASL technology

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions