Its Amazing
I really like Dubverse for a lot of reasons,
You can dub videos that have different languages to multiple languages( frankly speaking a lot of options for voices on dubverse ).
I mostly use it for generating AI voices which are always real human-like.
I have requested that I need more voices for English and they have added them right away! I am very thrilled by the community as well.
The only thing I expected would be in the dubbing version - I tried to generate a video from English to a different language with a YouTube link, and what I observed was Since the translated language has more words to convey the same message the dub version voice was really fast.
For example - In English, I want to watch TV but in the translated language it's like fsffhjshfvfsj skhjdsihfcsidf skdhjfsdfshjdf ksjdfsahfuhwuiehids sdfhsidufhsuid, since the words are too many in that particular language the reader has to read it too fast to cover the time. Hope this changes in the future or if it's already there then I should be able to adjust the translated voice.
Thank you for such an amazing software.
Kalpana_Dubverse
May 16, 2024Hello 115844330755730876408,
Thank you for your kind review! We are a user-focussed company and pride ourselves in fulfilling our users' needs. We are also glad to hear your encouraging words about the community.
Yes, you are exactly right in the insight that the fast speaking in the dubbed version is caused by the fact that the same idea is conveyed by a different number of syllables in various languages.
While AI dubbing isn't smart enough at the moment to account for this discrepancy, we have a few solutions:
1. Available on webapp
Adjusting the translated voice: https://help.dubverse.ai/en/articles/8028305-using-redraft-retune-resync-modes
Within the Studio, go to the Resync mode.
a) You can get there by going to the Watch page of your dubbed video -> Menu -> Improve Sync, or via the project card on the Home Page -> Studio -> Resync
b) You will see fast-speaking segments highlighted in red (high Characters per Second CPS).
c) You can move the segments on the timeline below to bring the CPS down, or choose to rephrase what is being said in the Redraft mode.
2. Next up:
Upcoming solution - choose among the various options of phrasing of an idea based on the recommendations within the system.
We are constantly updating the product to add new features and novel solutions, so please watch out for more! We would also love to hear more feedback from you on the new solutions so please stay connected via email to friends@dubverse.ai or via the usual Support chat on the webapp.
Thank you again for being a member of the Dubverse fam!