Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Swallowing words, reading normally at first, then speeding up, and then not reading the last word of the sentence completely #632

Open
6 tasks done
Liwenru88 opened this issue Oct 23, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@Liwenru88
Copy link

Liwenru88 commented Oct 23, 2024

Self Checks

  • This template is only for bug reports. For questions, please visit Discussions.
  • I have thoroughly reviewed the project documentation (installation, training, inference) but couldn't find information to solve my problem. English 中文 日本語 Portuguese (Brazil)
  • I have searched for existing issues, including closed ones. Search issues
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template and fill in all required fields.

Cloud or Self Hosted

Self Hosted (Source)

Environment Details

ubuntu 20.04,python3.10 ,torch2.4.1+cu121

Reference Audio:
http://101.201.69.129:22122/audio/tts-reference-audio/f8693be5-13de-423d-bae2-ba8d6ddb5ff3.wav

Steps to Reproduce

Example text:摇身化为冲击一线的卫士,他们也有家庭,也有妻子爱人和父母,但他们不曾畏惧,不曾退缩,全国各地的医护人员,自发组成应援团队,身负神圣的使命,前往湖北一线,此时的他们也是逆行者,在人们纷纷远离这座城市时,他们决定迎难而上,因为在离开医校进入工作时,他们做了庄严的宣誓,但这不是义务,更多的是一份责任,一份担当,一份大爱无疆

✔️ Expected Behavior

Complete reading verbatim

❌ Actual Behavior

Speed ​​up in the middle, and fail to read the last word completely
http://123.57.76.115:22122/test-video/error.wav

@Liwenru88 Liwenru88 added the bug Something isn't working label Oct 23, 2024
@PoTaTo-Mika
Copy link
Collaborator

We have made some DPO tricks to the model, this problem is now relieved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants