Add finger landmarks (e.g. fingertips) to Body Pose Tracking #5884
Labels
platform:javascript
MediaPipe Javascript issues
type:feature
Enhancement in the New Functionality or Request for a New Solution
MediaPipe Solution (you are using)
0.4
Programming language
JavaScript
Are you willing to contribute it
None
Describe the feature and the current behaviour/state
Would like to be able to access and track some finger landmarks, in conjunction with the body pose tracking. Ideally, this would be adding 10 additional landmarks to the Body, representing the hand finger tips.
Will this change the current API? How?
Yes, landmarks for body would be extended to include additional fingertip positions
Who will benefit with this feature?
The benefit is that you'd be able to do detection of pinches/grabs with the body pose tracker, without needing to also run a separate Hands pose tracking task.
Please specify the use cases for this feature
Pinch / Grab detection, allowing body pose tracker to detect when a person wants to move a virtual object or do something requiring activation/deactivation, e.g. virtual painting / musical expression / moving objects
Any Other info
No response
The text was updated successfully, but these errors were encountered: