The goal was to do all that for every character in the open world. Due to the game’s vast scope, CDPR needed to do all of that to capture zero face motion. To do this, the studio explained in Jali Research’s Lip Syncing and Facial Animation Tech how characters’ faces move.
Cyberpunk 2077 has full lip-sync for each character in all 10 dubbed languages
Crazy – and horrible to see for languages that often get very little support at times. Great work by all. pic.twitter.com/hwvaTWb9ei
– Shinobi602 (@ shinobi602) October 20, 2020
Some characters in Cyberpunk 2077 Speak multiple languages, sometimes switching between them in a single sentence. To account for that, transcript tagging was used. Tags also helped adjust a character’s facial expressions when their emotional state changed within a line of dialogue. The system also used audio analysis to replicate the emotions of a vocal performance in animations.
CDPR used algorithms that helped it animate the katkneys The Witcher 3, And this is an evolution of that approach. Many games use motion capture on a lip sync dialog in just one language, which can break immersion somewhat for players switching separately.
While in procedurally generated animations Cyberpunk 2077 They may not be as elaborate or expressive as some other AAA games, they can add experience for many players who would like to play in different languages. You will be able to think closely about how you work in practice when you come into the game on 19 November.