🔥 r1.2.0 release note

[lym0302]

S2T

• Fix conformer/transformer multi GPU training. [s2t] fix conformer/transformer multi-gpu training, maybe impact dy2st #2327 [s2t] fix asr_engine.py #2334 [s2t] fix format test=asr #2336 [s2t] DataParallel init method changed, fixed conformer could not multi-gpu training and don't affect dy2st #2372 by @Zth9730
• Fix deepspeech2 decode_wav. [s2t] fix deepspeech2 decode_wav  #2351 by @Zth9730
• Support BiTransformer decoder. [s2t] support bitransformer decoder #2415 by @Zth9730

T2S

• Update VITS to support VITS and its voice cloning training on AISHELL-3. [TTS]Update VITS to support VITS and its voice cloning training on AIShell-3 #2268 by @HighCWu
• Add ERNIE-SAT synthesize_e2e. [tts][ernie_sat]add ernie sat synthesize_e2e #2287 [TTS][ERNIE-SAT]clean old ernie sat inference scripts #2316 [TTS]fix gpus of ernie_sat #2355 [TTS] fix some bugs of ERNIE-SAT #2378 [TTS]fix ERNIE-SAT bug when edit the end of sentenses #2432 by @yt605155624
• Specify the input data type of G2PW. [TTS]指定G2PW的传入数据类型 , test=tts #2288 by @kslz
• Add TTS finetune example. [tts] add tts finetune example #2297 [tts] finetune add frozen  #2385 [tts] update finetune yaml and readme #2418 [tts] Update finetune #2430 by @lym0302
• Fix Chinese English mixed TTS frontend. [tts] fix mix frontend #2299 Fix mix front #2493 by @lym0302
• Add words into polyphonic.yaml for g2pW. add chinese words correct phonic,test=tts #2300 by @david-95
• Update the quantifier unit in Text Normalization. [TTS][TN] Update quantifiers #2308 by @pengzhendong
• Fix Chinese frontend bugs. add thanks into readme, append data for chinese unit #2312 [TTS]fix bug of tone modify #2323 by @david-95
• Add AISHELL-3 Voice Cloning with ECAPA-TDNN speaker encoder. [TTS]add aishell3 voice cloning with ECAPA-TDNN spk encoder #2359 [TTS]rm random spk embedding in voice cloning #2429 by @yt605155624
• Add pre-install doc for G2P and TN, update version of pypinyin. Added pre-install doc for G2P and TN modules and updated the dependency version of pypinyin #2364 by @WongLaw
• Add tools to compare two test results of G2P to show differences. add tool to compare two tests results, show difference  #2367 by @david-95
• Revise must_neural_tone_words. Revised must_neural_tone_words, test=doc. #2370 by @WongLaw
• Add type-hint for g2pW. [TTS]add typehint for g2pw #2390 by @yt605155624
• Replaced fixed path with path variable in MFA. Replaced the fixed path with the dynamic path in MFA, test=doc #2416 by @WongLaw
• Solve "unknown format: 3" for wavfile.write(). Solve "unknown format: 3" #2422 by @zhoupc2015

Text

• Create preprocess.py for Punctuation Restoration. Create preprocess.py #2295 by @THUzyt21

Demo

• Add Voice Cloning, TTS finetune, and ERNIE-SAT in speech_web. use cmd for voice clone , finetune and ernie-sat #2412 update readme and fixed bug in ngpu #2451 by @iftaken

Server

• Add num_decoding_left_chunks in streaming_asr_server's config. fix the bug "can't start ASR streaming_server" #2337 by @THUzyt21
• Removed useless spk_id in speech_server and streaming_tts_server, support Chinese English mixed TTS server engine. Removed useless spk_id in speech_server and streaming_tts_server from demos, and support bilingual server engine, test=tts #2380 by @WongLaw

Doc

• Add Chinese doc and language switcher for metaverse, style_fs2 and story_talker. Add Chinese doc and language switcher for demos of metaverse, style_fs2 and story_talker #2357 by @WongLaw
• Update API docs. [doc]update api docs #2406 by @yt605155624
• Add finetune demos in readthedocs. [doc]add finetune demos in readthe docs #2411 by @yt605155624

Test

• Add barrier for distributed training using multiple machines. Add barrier for benchmark #2309 Add barrier for distributed training using multiple machines #2311 by @sneaxiy
• Fix prepare.sh for PWGAN TIPC. fix prepare.sh #2376 by @yuehuayingxueluo

Other

• Format paddlespeech with pre-commit. format paddlespeech with pre-commit #2331 by @yt605155624

Acknowledgements

Special thanks to @yt605155624 @lym0302 @THUzyt21 @iftaken @Zth9730 @zhoupc2015 @WongLaw @david-95 @pengzhendong @kslz @HighCWu @yuehuayingxueluo @sneaxiy @SmileGoat

New Contributors

• @HighCWu made their first contribution in [TTS]Update VITS to support VITS and its voice cloning training on AIShell-3 #2268
• @pengzhendong made their first contribution in [TTS][TN] Update quantifiers #2308
• @Zth9730 made their first contribution in [s2t] fix conformer/transformer multi-gpu training, maybe impact dy2st #2327
• @WongLaw made their first contribution in Add Chinese doc and language switcher for demos of metaverse, style_fs2 and story_talker #2357
• @yuehuayingxueluo made their first contribution in fix prepare.sh #2376
• @zhoupc2015 made their first contribution in Solve "unknown format: 3" #2422

Full Changelog: r1.1.0...r1.2.0