Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

👨🏻‍🦱 TTS 男性音色(Male speaker)(如何更换音色) #1620

Closed
yt605155624 opened this issue Mar 29, 2022 · 12 comments
Closed

Comments

@yt605155624
Copy link
Collaborator

yt605155624 commented Mar 29, 2022

there are no single speaker datasets for male, but in multi-speaker tts datasets(aishell3, vctk),there are Male speakers,
You can find speaker_id_map.txt in ~/.paddlespeech/models/fastspeech2_aishell3-zh/fastspeech2_nosil_aishell3_ckpt_0.4/speaker_id_map.txt or ~/.paddlespeech/models/fastspeech2_vctk-en/fastspeech2_nosil_vctk_ckpt_0.5/speaker_id_map.txt and check the gender of speakers in the origin datasets(aishell3/vctk), then, use --spk_id to use the speaker you want in multi-speaker tts datasets

more usage for multi-speaker cli https://github.com/PaddlePaddle/PaddleSpeech/tree/develop/demos/text_to_speech

also see #1373

@yt605155624
Copy link
Collaborator Author

yt605155624 commented Apr 19, 2022

Recommended Male Speaker:

VCTK: spk_id = 7

paddlespeech tts --am fastspeech2_vctk --voc pwgan_vctk --input "Life was like a box of chocolates, you never know what you're gonna get." --lang en --spk_id 7 --output output_en.wav

aishell3: spk_id = 167

paddlespeech tts --am fastspeech2_aishell3 --voc pwgan_aishell3 --input "你好,欢迎使用百度 飞桨深度学习框架!" --spk_id 167

@yt605155624 yt605155624 pinned this issue May 25, 2022
@ayongbox
Copy link

ayongbox commented Jun 9, 2022

there are no single speaker datasets for male, but in multi-speaker tts datasets(aishell3, vctk),there are Male speakers, You can find speaker_id_map.txt in ~/.paddlespeech/models/fastspeech2_aishell3-zh/fastspeech2_nosil_aishell3_ckpt_0.4/speaker_id_map.txt or ~/.paddlespeech/models/fastspeech2_vctk-en/fastspeech2_nosil_vctk_ckpt_0.5/speaker_id_map.txt and check the gender of speakers in the origin datasets(aishell3/vctk), then, use --spk_id to use the speaker you want in multi-speaker tts datasets

more usage for multi-speaker cli https://github.com/PaddlePaddle/PaddleSpeech/tree/develop/demos/text_to_speech

also see #1373

How to check the gender of the speaker?

@yt605155624
Copy link
Collaborator Author

yt605155624 commented Jun 16, 2022

there are no single speaker datasets for male, but in multi-speaker tts datasets(aishell3, vctk),there are Male speakers, You can find speaker_id_map.txt in ~/.paddlespeech/models/fastspeech2_aishell3-zh/fastspeech2_nosil_aishell3_ckpt_0.4/speaker_id_map.txt or ~/.paddlespeech/models/fastspeech2_vctk-en/fastspeech2_nosil_vctk_ckpt_0.5/speaker_id_map.txt and check the gender of speakers in the origin datasets(aishell3/vctk), then, use --spk_id to use the speaker you want in multi-speaker tts datasets
more usage for multi-speaker cli https://github.com/PaddlePaddle/PaddleSpeech/tree/develop/demos/text_to_speech
also see #1373

How to check the gender of the speaker?

you should check the gender in original datasets

for example aishell3, there is a spk-info.txt, which contains the gender info.

data_aishell3
├── ChangeLog
├── phone_set.txt
├── ReadMe.txt
├── spk-info.txt
├── test
└── train
# voice-file name; age group; gender; accent
# In years, A:< 14, B:14 - 25, C:26 - 40, D:> 41.

SSB1837 B       female  north
SSB0578 B       female  north
SSB1216 B       female  north
SSB1161 B       female  north
...

@yt605155624
Copy link
Collaborator Author

yt605155624 commented Jun 16, 2022

Hi all, we provide the

spk_id gender mos result in the following files
aishell3_gender.pdf
VCTK_gender.pdf

speaker info from original datasets:
aishell3_spk-info.txt
vctk_speaker-info.txt

@yt605155624 yt605155624 self-assigned this Jul 7, 2022
@iftaken
Copy link
Collaborator

iftaken commented Aug 1, 2022

you can try it in aistuido

@yt605155624 yt605155624 changed the title TTS 男性音色(Male speaker) 👨🏻‍🦱 TTS 男性音色(Male speaker) Sep 30, 2022
@thehzzz
Copy link

thehzzz commented Oct 19, 2022

请问TTS 男性音色怎样去调整合成语音的语速和音量呢?

@yt605155624
Copy link
Collaborator Author

请问TTS 男性音色怎样去调整合成语音的语速和音量呢?

Duplicate of #2556

@yt605155624 yt605155624 unpinned this issue Oct 24, 2022
@yt605155624 yt605155624 changed the title 👨🏻‍🦱 TTS 男性音色(Male speaker) 👨🏻‍🦱 TTS 男性音色(Male speaker)(如何更换音色) Oct 24, 2022
@EzrealoveQXY
Copy link

image
这个有使用demo吗

@stale
Copy link

stale bot commented Jan 5, 2023

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the Stale label Jan 5, 2023
@yt605155624 yt605155624 removed the Stale label Feb 7, 2023
@stale
Copy link

stale bot commented Mar 25, 2023

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the Stale label Mar 25, 2023
@stale
Copy link

stale bot commented May 21, 2023

This issue is closed. Please re-open if needed.

@stale stale bot closed this as completed May 21, 2023
@treya-lin
Copy link

Hi all, we provide the

spk_id gender mos result in the following files aishell3_gender.pdf VCTK_gender.pdf

speaker info from original datasets: aishell3_spk-info.txt vctk_speaker-info.txt

请问团队在训练tts的时候是不是并没有使用aishell3全部的说话人?比如 fastspeech2_aishell3_ckpt_1.1.0 我看 speaker_id_map.txt 里面是有174个人,但是aishell3原始数据集一共200多个说话人,请问训练时是有什么筛选考虑吗 ?谢谢!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants