Skip to content

jellydreams/VTS-Fullbody-Tracking

Repository files navigation

VTS FULLBODY TRACKING

🔗 website: vts-fullbody-tracking.gitlab.io

Last Release VTS FULLBODY TRACKING Discord Twitter Follow

This plugin integrates full body tracking functionality using Mediapipe. It allows users to use tracked body parameters as inputs to control Live2D model in VTube Studio or Nizima LIVE.

Demo Tracking Arms

THIS PLUGIN IS UNDER DEVELOPMENT

This plugin may contain bugs and lack certain features.
Visit the Wiki or Website for more information on how the plugin works.
Join Discord Server to share tests and feedbacks, ask questions or get help.

How you can Help

  • Live2D Rigger: Help understand how to effectively rig models for the body parts feature
  • Live2D Vtuber: Experiment with usability and performance for movement and configuration in VTube Studio or Nizima LIVE
  • Developper: Contributions are welcome to improve this plugin

Troubleshooting

  • Currently, there might be a latency of a few seconds
  • Tracking input may be inaccurate and exhibit occasional jumps

Run the Plugin

Requirements: Window, VTube Studio, Camera

  1. Download the executable from the releases page
  2. Connect a Camera
  3. Double-click on the executable file VTS_Fullbody_Tracking.exe to launch the plugin. A settings window will appear.
  4. Select your camera
  5. Open Software (VTube Studio or Nizima LIVE)
  6. click on the 'Start Tracking' button
  7. Allow the plugin in your software. Window displaying a preview of pose tracking will appear.
  8. Configure your model's parameter settings, using plugin parameters as inputs. you can now choose body parts X, Y, Z coordinates, and visibility as inputs

📖 Wiki Section - Run the plugin

Settings

Peview Camera

Displays the image captured by the camera

default Preview Camera
exemple_preview.png exemple_camera_preview.png

📖Wiki Section - Settings Window

Custom Parameters

This plugin add new controls for various body parts in Vtube Studio.
Each body part has parameters for controlling its position and visibility.

List Bodyparts MediaPipe

  • Arms: Shoulders, Elbow, Wrists
  • Torso: Clavicles, Hips
  • Legs: Knees, Ankles
  • Feet: Heels, Feet Index
  • Hands: Pinkies Knuckles, Index Knuckles, Thumb Knuckles

📖Wiki Section - List of Parameters