MSV007MSV007
MSV007PLUS
Apr 15, 2024

Q: I love your concept of generating realistic and natural movement for inanimate character images, accompanied ...

by lip synchronization with narrative audio. Considering that your main product is to animate inanimate character images with narrative audio; I believe that to make your product a gem, you should focus all your energy on the following recommendations:

Natural and Realistic Movement: It is essential to focus efforts on the continuous improvement of character animation. The goal is to achieve a level of movement that emulates the naturalness and fluidity of human movement, minimizing any facial distortion and completely eliminating the annoying line that appears at the bottom of the character.

Focus on Facial Animation: The animation should be subtly limited to the face, keeping the rest of the image static to avoid distortions. It is vital that the lip synchronization with the narrative audio is precise and subtle, contributing to a more immersive and credible experience.

Realistic Details: When the character’s mouth is closed, it is crucial to include teeth that look realistic. If the character smiles, the fusion of mouth movement should be as natural and realistic as possible, following examples like those presented at D-ID Creative Reality Studio.

High-Quality Multilingual Voices: The platform should incorporate a variety of high-quality multilingual voices that also offer customizable options for emotions, tone, and speed, similar to those offered by platforms like elevenlabs.io and naturalreaders. These voices should stand out from the typical and monotonous ones used on other platforms, thus providing a unique and attractive auditory experience.

Editing Tools: It is recommended to implement an efficient background removal tool and the option to place the character on a green screen. This will allow users to employ the characters on various video editing platforms creatively. Additionally, it would be beneficial to allow the animation of half-body or full-body characters, thus expanding creative possibilities.

Conclusion: By adopting these recommendations, I believe that your platform will not only significantly improve the quality of your product but will also reinforce its position as an innovative leader in the animation of inanimate characters.

Founder Team
srpuppetry

srpuppetry

May 15, 2024

A: Hi @MSV007

Wow, you made our day! Thank you so much for such a wonder full and actionable feedback. This is so so useful!

> I love your concept of generating realistic and natural movement for inanimate character images, accompanied by lip synchronization with narrative audio. Considering that your main product is to animate inanimate character images with narrative audio; I believe that to make your product a gem, you should focus all your energy on the following recommendations:
❤️❤️

> Natural and Realistic Movement: It is essential to focus efforts on the continuous improvement of character animation. The goal is to achieve a level of movement that emulates the naturalness and fluidity of human movement, minimizing any facial distortion and completely eliminating the annoying line that appears at the bottom of the character.

Yes, I agree. This is an ongoing task for us and we will make improvements to the model slowly but surely.

> Focus on Facial Animation: The animation should be subtly limited to the face, keeping the rest of the image static to avoid distortions. It is vital that the lip synchronization with the narrative audio is precise and subtle, contributing to a more immersive and credible experience.

We've had trouble with lip sync in some situations. We just launched our video-to-video feature on the website. That will give you better lip sync for your own voice. Please try it out and let us know what you think

> Realistic Details: When the character’s mouth is closed, it is crucial to include teeth that look realistic. If the character smiles, the fusion of mouth movement should be as natural and realistic as possible, following examples like those presented at D-ID Creative Reality Studio.

Absolutely. We had a mechanism that generated better teeth, but the problem was that it was too slow. It would take 30 mins for a 1 min video. That said, we need to improve our teeth rendering.

> High-Quality Multilingual Voices: The platform should incorporate a variety of high-quality multilingual voices that also offer customizable options for emotions, tone, and speed, similar to those offered by platforms like elevenlabs.io and naturalreaders. These voices should stand out from the typical and monotonous ones used on other platforms, thus providing a unique and attractive auditory experience.

We are in the process of moving to 11labs voices! That should bring in a lot more fidelity to voices. But yes, totally agree.

> Editing Tools: It is recommended to implement an efficient background removal tool and the option to place the character on a green screen. This will allow users to employ the characters on various video editing platforms creatively. Additionally, it would be beneficial to allow the animation of half-body or full-body characters, thus expanding creative possibilities.

Background removal/transparency is in the works and should land soon!

> Conclusion: By adopting these recommendations, I believe that your platform will not only significantly improve the quality of your product but will also reinforce its position as an innovative leader in the animation of inanimate characters.

Again, thank you so much for your purchase and such thoughtful feedback. This is invaluable to us. Thank you!

Share
Helpful?
4
Log in to join the conversation