Home

Musical Gestures Toolbox for Matlab is a collection of high-level modules targeted at researchers working with video recordings. It includes visualization techniques such as motion videos, motion history images, and motiongrams; techniques that in different ways, allow for looking at video recordings from different temporal and spatial perspectives. It also includes basic computer vision analysis, such as extracting quantity and centroid of motion and using such features in analysis.

The toolbox was originally developed to analyse music-related body motion (musicians, dancers and perceivers), but is equally useful for other disciplines working with video recordings of humans, such as linguistics, pedagogics, psychology, and medicine.

Download

You can clone the repository or download the latest version from the repository.

Install

1. Unzip the files and place them wherever you like on the drive.
2. Add the folder to your Matlab path (see below).
3. Optional: If you want to work with audio and motion capture data functions, you will also need to install the MoCap Toolbox and MIRToolbox. The steps of installation are the same as MGT above.
4. Optional 2: For the optical flow function work, you will need to have installed the Mathworks Signal Processing Toolbox and Image Processing Toolbox.

Linux

On Linux (at least Ubuntu), you need to have the latest installed GStreamer plugins to have Matlab read MP4-files. This can be done with:

sudo apt install ubuntu-restricted-extras
sudo apt install gstreamer1.0*

Add toolbox to the path

To add the toolbox(es) to the Matlab path:

• In Matlab 2015a or more recent: on the Home tab, in the Environment section, click "Set Path".

• In the new "Set Path" window, click on the second button "Add with Subfolders".

• In the file browser, select the folder you downloaded and unzipped and click "Open".Then click the "Save" button.

Functions

The Musical Gestures Toolbox contains functions to analyse and visualise a video, audio, and mocap data. There are four categories of functions:

• Data input and edit functions
• Data preprocessing functions
• Visualization functions
• Middle and higher-level feature extraction functions

Look at the examples to get an idea about how to use the toolbox.

Problems

These are some of the known issues. Please help improve the toolbox by adding bugs and feature requests in the issues section.