#8385 why is it like when i translate the video into hindi it's alignmnt is good it slows down the video perfectly but when i

152.59**9 Posted at: 1 hour ago

why is it like when i translate the video into hindi it's alignmnt is good it slows down the video perfectly but when i translate it in english it doen't do so it even doesn't slows down the video and the alignment is worse

1 Replies

#1 DeepSeek reply at 1 hour ago

Root cause: the alignment engine only reacts when the dubbed audio is longer than the original subtitle time slot. When dubbing to Hindi, the translated text expands (Hindi usually takes more syllables/time than the source), so the engine is forced to speed up the audio and, when that isn't enough, slow down the video — that's why you see the slow-motion working perfectly. English translations are usually much shorter/faster than the source and than Hindi, so per line the TTS output fits inside the original slot (or is even shorter). In that case there is nothing to compress, so 视频慢速 never triggers and the leftover time is simply filled with silence — the result looks/sounds misaligned even though no error occurred.

What to do:

  1. Make sure both 配音加速(TTS Speedup) and 视频慢速(Slow video) are checked. Note: slow video still only activates when the dub exceeds the slot — it is not a per-language setting.
  2. Enable 二次识别(SecondarySTT) (requires a voice role selected, and must NOT use bilingual subtitles). This re-transcribes the newly generated English dubbing with faster-whisper (large-v3-turbo by default) and regenerates subtitles that are tightly matched to the actual audio, instead of keeping the original timestamps.
  3. Reduce the mismatch at the source: in Menu → Tools → Advanced Options → Dubbing, enable Removes the mute buffer at the beginning and end of each subtitle's audio (or Removes all mute buffers), and set Mute removal level to max if needed.
  4. Tune English speech rate: set 配音语速(Speed+%) in More... (try -10% to -20% if English reads too fast / too short, +10% to +15% if too long). Also check Audio speed-up max rate and Video slow-down max rate in Advanced Options → Alignment (defaults 100 / 10).
  5. For subtitle/voice sync complaints also verify subtitle embed type: with Soft subtitles the subtitle track keeps its own timing and any drift is very visible; Hard subtitles bakes it into the picture.
  6. When retrying the same video, always check 清理已生成(Clear Output) and re-run, otherwise the previously generated SRT/dub files are reused and your new settings appear to have no effect.

If alignment is still off after the above, report: software version number, whether 音频加速/视频慢速/二次识别 were all checked, and the direction of the drift (voice before subtitle or subtitle before voice), plus the latest logs/ file.

请查阅相关文档:

Thinking...
Post Your Reply
If you have more than 50 messages, you will no longer receive an automatic reply. Please ask a new question!
Open source and free maintenance is not easy. If this project is helpful to you, please consider making a small donation to help the project continue to maintain and update.

Dondate via ko-fi.com

Related resource