Enterprise AI video platform Synthesia has unveiled a new video and voice engine for AI avatars, pairing state-of-the-art voice cloning with a diffusion transformer (DiT) model. Express-2 claims to combine accent-preserving voice cloning with expressive facial expressions, accurate lip sync, and natural hand and body gestures to replicate the voices and gestures of professional speakers.
Express-2
Express-2 generates 1080p, 30fps avatar videos of arbitrary length, with a built-in feature that is composed of two tightly-connected parts:
- Express-Voice: a proprietary in-context learning sub-system that can clone a voice, preserving identity, accent, and expressiveness without any fine-tuning.
- Express-Video: an avatar animation and rendering sub-system architected on a video stack that translates speech into natural gestures, facial dynamics, and photorealistic frames.
“Unlike other generative AI tools that have length limitations, Express-2 offers unprecedented quality without compromise: you get 1080p at 30fps video as an output, with consistent identity and natural co-speech gestures. With no limit on video duration, Express-2 delivers human-like performances that are highly engaging, leading to long-form videos with AI avatars that deliver information in an instructional and entertaining way,” explained chief technology officer for Synthesia, Peter Hill, in an article.
Responsible AI governance
Hill assured that Synthesia is committed to responsible AI governance, moderating content at creation to ensure the ethical and responsible use of AI. The company makes this approach transparent via an AI Governance portal, providing you with the confidence that your content is being handled responsibly.
“These safeguards carry through Express-2 and will continue to be updated as we introduce new features. If you’re a paying Synthesia customer and want to bring human-quality performance to your videos at the speed your business moves, we’d love you to try out Express-2 today. Synthesia has rolled out several new avatars powered by Express-2 on its platform, and is making them available for free to all paying customers,” Hill concluded.
