Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add face blendshape calibration #53

Conversation

the-furry-hubofeverything
Copy link
Contributor

Record then average the blendshape values and then subtracting it from mediapipe output.

I have a "resting bitch face" and so my lips always seems puckered.

this will skip any eye blendshapes.

Average the blendshape values in 200ms and then subtracting it from mediapipe output
@the-furry-hubofeverything
Copy link
Contributor Author

2024-11-25.04-02-56_shortened.mp4

@copygirl
Copy link

this will skip any eye blendshapes.

Not a solution for my eyes generally not staying open then? 😅

@the-furry-hubofeverything
Copy link
Contributor Author

this will skip any eye blendshapes.

Not a solution for my eyes generally not staying open then? 😅

@copygirl I skipped eye blendshapes because the blendshapes for gaze (up, down, left and right) are not easy to calibrate with. Eyes move all the time.

But I think eyelids can be added to the calibration.

@the-furry-hubofeverything
Copy link
Contributor Author

this will skip any eye blendshapes.

Not a solution for my eyes generally not staying open then? 😅

@copygirl After a quick experiment, I think eyelid calibration should be a separate thing, or at least the calibration process needs to be more accurate before then. When I include the eyelids, my model stops blinking.

So, I think that might be a future problem. Maybe as a multiplier of some sort.

@ExpiredPopsicle ExpiredPopsicle merged commit 1b68f61 into ExpiredPopsicle:main Nov 29, 2024
@the-furry-hubofeverything the-furry-hubofeverything deleted the mediapipeCalibration branch November 29, 2024 08:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants