Q: ETA on fixing the lip sync issues?
Hi,
you have a great product here with lot's of potential!
Unfortunately, the most important feature is currently buggy: For my clones/instant avatars (and photo avatars) the lip sync is so far off that even I can see it, and thats with voice cloning. If I use a spoken voice over, it gets worse. I can even see thsi for your stock avatars, like the guy doing a review with a scene inside an airplane. Heygen is far better, but I know someone who can lip-read — she instantly spotted it even there (I asked for an opinion on "a color grade", but she spotted the video not being real in 1 sec).
When do you plan to improve the lip sync? It currently screams FAKE!, AI gen! It's IMHO very bad, BUT also the only obstacle in your way to having an awesome product! Voice clone is already pretty good, but the AI avatars are the main use case.
Thanks!
AnbangXu_JoggAI
Edited Jan 28, 2025A: When did you try it? Recently we updated a new version of lipsync.
Please send me your account and output video to my email anbangx@jogg.ai. I'll look into it.
Additionally, we understand the importance of lip sync and are actively working on improving it. In 2025, we’re dedicating more resources to this.
Zappy7I was just about to ask the same question. I used your trial and the lip sync is awfully off. Everything else seems great, especially the create avatar from photo. It looks so real ... until you look at lip sync which destroys everything. This is keeping me away from buying your deal.
SGWarriorPLUSZappy7, I am interested to know if the lip sync issue is before or after rendering the video? Seems like the lip sync issue is quite bad.
Our lipsync should not be so bad. Please send me your account and output video to my email anbangx@jogg.ai. I'll look into it.
aiyesPLUS
Verified purchaser
I am a happy buyer here, the lip-sync after render is pretty good indeed. We have tried different languages and we are happy with it.
user3500PLUSVerified purchaser
Thanks for sharing your experiences! I bought it now hoping for updates (it improved since Dec). Created an instant avatar again today (HQ studio video), tried 2 recorded voice-overs + 3 clones in German. For 9:16 on a phone many people might not see issues, but for 16:9 full screen on a laptop, I see many issues ( I can't even lip-read, but have 10 years of professional video editing experience).
user3500PLUSVerified purchaser
Thanks @Anbang! I tried instant avatar on Dec 30 + photo avatar yesterday + watched your demo "Popular blogger"(guy in airplane).
After your comment I tried again today, it has much improved indeed, at least for instant avatar from HQ studio video. But I still see many glitches, even teeth changing shape for 0.5 seconds. I will email you details + timestamps tomorrow, thanks for looking into it!
user3500PLUSVerified purchaser
It's all after rendering and downloading the video (to avoid any issues with streaming etc). Seeing how much Jogg.ai already improved in the last two months, I am confident they can fix this - the body movements, eye and head movements are already so natural I can't believe it's AI. Even with photo avatar hand movements look like video recordings. It's just the lips/mouth movement and lip sync.
Sure. Just send me the bad cases. We'll look into them and fix them. As you know, generative-AI usually take some time to improve, but we’re continually working on it and believe it will get much better soon.
user3500PLUSVerified purchaser
Thanks again Anbang, I have created a new avatar, carefully watched for problems and have sent all the data to your email (Demo video and training data and timestamp info with problems). I hope you can fix it to improve the German lip sync!
CliffordPPLUSThe sample videos in the horizontal slider at https://www.jogg.ai/features/ai-avatar/ has the lip sync way off as well -- is this the best it gets or has it been improved since these samples were rendered?
Which one do you think it's way off. Please email me anbangx@jogg.ai.
CliffordPPLUSEdward, Charles, and Zuri (although Zuri says her name is Jordan)