The Lip-Sync Checklist That Keeps AI Dialogue From Sounding Like a Bad Dub
Five things I check before a single line of dialogue leaves the script and enters a generation pipeline.
The first time I put dialogue into a Lost Garden shot, I didn’t notice anything wrong for almost a full day. The line read fine. The voice was right. Then I watched the clip on my phone instead of my monitor and the mouth was landing on consonants a beat after the sound hit. Not much. Maybe eighty milliseconds. Enough that a friend who watched it cold asked if the video was buffering.
That gap is the whole problem with AI dialogue, and it’s smaller than people think. Human perception of lip-sync error isn’t measured in seconds, it’s measured in tens of milliseconds.The ITU’s own broadcast standard (BT.1359) puts the detectable threshold at audio leading video by more than 45ms, or lagging it by more than 125ms. Film post houses hold...
Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE
