-
-
Notifications
You must be signed in to change notification settings - Fork 763
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(model) : add segmentation model based on self-supervised representation #1362
Commits on May 5, 2023
-
add WaVLM-Base model to PyanNet.py in replacement of SincNet
Added WavLM-Base model which replaces the SincNet feature extraction model within the PyanNet architecture (loaded outside of the class from HuggingFace.co).
Configuration menu - View commit details
-
Copy full SHA for 6d3af2e - Browse repository at this point
Copy the full SHA 6d3af2eView commit details
Commits on May 9, 2023
-
2
Configuration menu - View commit details
-
Copy full SHA for d03906b - Browse repository at this point
Copy the full SHA d03906bView commit details
Commits on May 15, 2023
-
add support of all Torchaudio self-supverised models to PyanNet, incl…
…uding layer selection. Created a block (in replacement of the old WavLM one) called "selfsup.py" which loads and apply a specific SSL Torchaudio model, depending on PyanNet's input parameter. User can now also choose a specific layer which will then be used for feature extraction. Ex : seg_model = PyanNet(task=seg, model = "HUBERT_BASE", layer = 5) This will load "HUBERT_BASE" model and select the 6th layer for the feature extraction. If layer is not specified, will automatically use the first one (layer 0). All available models can be found at : https://pytorch.org/audio/main/pipelines.html
Configuration menu - View commit details
-
Copy full SHA for 3fc2d37 - Browse repository at this point
Copy the full SHA 3fc2d37View commit details
Commits on May 26, 2023
-
add support of ssl models from huggingface to pyannote using PyanHugg…
… class Can use pre-trained ssl models from huggingface using PyanHugg class. Tested (and working) models are : - "microsoft/wavlm-base" - "microsoft/wavlm-large" - "facebook/hubert-base-ls960" - "facebook/wav2vec2-base-960h" Class supports model and layer selection (as well as cache location for the downloaded model and configuration file). Ex : seg_model = PyanHugg(task=seg, selfsupervised={ 'model' : 'microsoft/wavlm-base', 'layer' : 2, 'cache' : 'mod_location/'})
Configuration menu - View commit details
-
Copy full SHA for 1e370fc - Browse repository at this point
Copy the full SHA 1e370fcView commit details
Commits on May 31, 2023
-
Configuration menu - View commit details
-
Copy full SHA for e170eed - Browse repository at this point
Copy the full SHA e170eedView commit details
Commits on Jun 5, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 9f81c30 - Browse repository at this point
Copy the full SHA 9f81c30View commit details
Commits on Jun 20, 2023
-
add support for fairseq pretrained ssl models
Can load a fairseq ckpt from a pretrained model (which is converted to torchaudio wav2vec2 format)
Configuration menu - View commit details
-
Copy full SHA for e5330fc - Browse repository at this point
Copy the full SHA e5330fcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7a21fc9 - Browse repository at this point
Copy the full SHA 7a21fc9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6243f91 - Browse repository at this point
Copy the full SHA 6243f91View commit details
Commits on Jul 5, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 328505c - Browse repository at this point
Copy the full SHA 328505cView commit details -
Configuration menu - View commit details
-
Copy full SHA for d4ddd53 - Browse repository at this point
Copy the full SHA d4ddd53View commit details
Commits on Jul 6, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 63a9e42 - Browse repository at this point
Copy the full SHA 63a9e42View commit details
Commits on Jul 10, 2023
-
Configuration menu - View commit details
-
Copy full SHA for cbd01a3 - Browse repository at this point
Copy the full SHA cbd01a3View commit details -
Configuration menu - View commit details
-
Copy full SHA for f608eb7 - Browse repository at this point
Copy the full SHA f608eb7View commit details
Commits on Jul 12, 2023
-
Configuration menu - View commit details
-
Copy full SHA for d7e9203 - Browse repository at this point
Copy the full SHA d7e9203View commit details
Commits on Jul 13, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 81aafdd - Browse repository at this point
Copy the full SHA 81aafddView commit details
Commits on Aug 2, 2023
-
Configuration menu - View commit details
-
Copy full SHA for b9c89b6 - Browse repository at this point
Copy the full SHA b9c89b6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8aba20e - Browse repository at this point
Copy the full SHA 8aba20eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4a8bfe2 - Browse repository at this point
Copy the full SHA 4a8bfe2View commit details
Commits on Sep 10, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 2323105 - Browse repository at this point
Copy the full SHA 2323105View commit details
Commits on Sep 13, 2023
-
Configuration menu - View commit details
-
Copy full SHA for cedf042 - Browse repository at this point
Copy the full SHA cedf042View commit details -
Configuration menu - View commit details
-
Copy full SHA for 06641bf - Browse repository at this point
Copy the full SHA 06641bfView commit details
Commits on Sep 15, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 31d08a4 - Browse repository at this point
Copy the full SHA 31d08a4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 421ba03 - Browse repository at this point
Copy the full SHA 421ba03View commit details
Commits on Sep 18, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 5f9211c - Browse repository at this point
Copy the full SHA 5f9211cView commit details