Skip to content

This script uses a modified pydub package (0.24.1) to segment and normalize raw conversational/speeches files for machine learning.

License

Notifications You must be signed in to change notification settings

Caldarie/Audio_segmenter

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

76 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Audio Segmentation

The scripts uses a modified pydub package (0.24.1) to segment and normalize raw conversational/speeches files for machine learning. Compared to using the standard pydub library, this script is optimized for processing audio by removing the need to use multiple loops to segment data.

Please be aware that this script can/may be broken if any other pydub versions are used.

audio_segmentation.ipynb

This script assumes that there is only one speaker. If you need to find the optimal silence threshold and length, please use 'parameter_tester.ipynb' to find the optimal values.

What this script will do is:

  1. Removes unnecessary long pauses/silences, but retaining natural silences which indicates the speakers thoughts or use of fillers.
  2. Splits the audio files into 5 second intervals. Files that are too short will be kept but labelled as "leftover"
  3. Normalize amplitude, chanhel, and sampling rate.
  4. [Future Feature] Removes background noise if applicable
  5. [Future Feature] Generates a unique adds id for each file

parameter_tester.ipynb

If you need to find the optimal parameters for removing silence in your audio.

  1. Open parameter_tester.ipynb. This script will take a sample of your original file, which can be used to test and find the optimal silence length and threshold.

  2. Run the first cell to splice a sample of your original raw audio data.

  3. Adjust the parameters in nonsilent_data = detect_nonsilent(normalized_sound, min_silence_len=4000, silence_thresh=-32, seek_step=1), then run the cell. It should output a series of time frames, for example:

Time frame

  1. Run the third cell to output wave graph.

  2. Using the wave graph, make sure that it matches with the time frame from the second cell. If it doesn't match, readjust the parameters again. Optimal parameters should match the time frames like this: Wave Graph

About

This script uses a modified pydub package (0.24.1) to segment and normalize raw conversational/speeches files for machine learning.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published