there was a small improvement in split, but still longer than 10 seconds and split are combined from multiple speakers dialogue, plus the dubbing part did not produce some of the audios and the final output has a lot of silent part. there are still issue on setting it up to correctly work.
here are the log details and other results
log result during run
[DEBUG] 上次缓存的角色:clone,字幕嵌入类型:0,发音语言:Simplified Chinese,目标语言:English,目标语言代码:en,模型:1.7B,TTS渠道[2]
[DEBUG] 可用 Nvidia 显卡数: 0
[DEBUG] 找到 0 个 Nvidia GPUs, 耗时: 0s
[DEBUG] 返回缓存的编解码器 Darwin-264: h264_videotoolbox
[DEBUG] 返回缓存的编解码器 Darwin-265: hevc_videotoolbox
[DEBUG] start 9 jobs
[DEBUG] app_cfg.proxy=''
[DEBUG] 可以使用 huggingface.co
[DEBUG] [TransCreate]最终配置信息:self=TransCreate(uuid='dc6e523b7f', proxy_str=None, last_down_time=0, precent=1, hasend=False, should_recogn=True, should_trans=True, should_dubbing=True, should_separate=True, should_hebing=True, source_srt_list=[], target_srt_list=[
......
e='Qwen3-ASR'],耗时26.127667903900146s
[DEBUG] Qwen-asr返回的字词时间戳数据:jsdata=[SrtItem(text="It tastes exactly like my grandma's.", start_time=9168, end_time=11552, startraw='00:00:09,168', endraw='00:00:11,552', line=1, time='00:00:09,168 --> 00:00:11,552', spk='', filename='/Users/username/pyvideotrans_404/tmp/2126/clip_1783551407.813813/audio_0.wav')]
[DEBUG] 移除无效字幕行
[DEBUG] 修正重叠时间轴
[DEBUG] 开始移除每条字幕末尾标点
[DEBUG] 二次识别成功完成
[DEBUG] 合并背景音 beishu=1,atime=73258,vtime=27156
[DEBUG] 视频时长73266ms-音频时长27156ms=46110ms,需延长音频
[DEBUG] 当前原始视频是标准264,输出也是264,未视频慢速,未嵌入硬字幕,放弃视频末尾处理,实现无损输出。音频时长-视频时长=0ms
[DEBUG] 返回缓存的编解码器 Darwin-264: h264_videotoolbox
[DEBUG] [最终视频合成]copy模式,无需重新编码:
['-y', '-progress', 'compose1783551447.491819.txt', '-i', 'novoice.mp4', '-i', 'will_embed.m4a', '-map', '0:v', '-map', '1:a', '-c:v', 'copy', '-c:a', 'copy', '-movflags', '+faststart', '-shortest', 'laste_target.mp4']
[DEBUG] runffmpeg:cmd=['ffmpeg', '-hide_banner', '-nostdin', '-ignore_unknown', '-threads', '0', '-y', '-progress', 'compose1783551447.491819.txt', '-i', 'novoice.mp4', '-i', 'will_embed.m4a', '-map', '0:v', '-map', '1:a', '-c:v', 'copy', '-c:a', 'copy', '-movflags', '+faststart', '-shortest', 'laste_target.mp4']
subtitle [zh-cn.srt] ASR result (original audio)
1
00:00:09,184 --> 00:00:13,104
这味道跟我外婆做的一模一样。
2
00:00:13,408 --> 00:00:23,408
他走了八年了,我以为这辈子再也吃不到这个味道了。网上大家都叫您规矩,总厨,您被一个经理辜负之后,只靠规矩就翻了盘,您怎么看?
3
00:00:23,424 --> 00:00:36,608
那些规矩从来不是为了反击谁,我只是在那个晚上想明白了一件事。:尊重不是别人给你的,是你自己赢回来的手艺长在手上。
4
00:00:36,976 --> 00:00:48,976
底线刻在心里,这两样东西谁都拿不走,不管你在多大的厨房里。
5
00:01:00,000 --> 00:01:09,616
爸跟你当年种的那棵是同一个品种,他们说这边的土好能长大。
subtitle (en.srt) trans result (transcription) - final version
1
00:00:09,168 --> 00:00:11,552
It tastes exactly like my grandma's
other part did not result any audio
here are my settings:
-used [tenvad]
-VAD speech probability threshold = 0.3
-no speech threshold = 0.3
-VAD max speech = 10s
-VAD min silence = 300ms
-recognition(2) max duration = 2s (default)
-recognition(2) min duration = 1000s (default)
-VAD min speech = 3000s
-short sub merge = checked
-whisper pre-segment audio = checked
-model speaker separation = pyannote (but speaker diarization is not checked during run)
-recognition accuracy (beam) = 1
-recognition accuracy (best) = 1
-context awareness = unchecked
-temperature = blank
-on ASR channel = [default split] (no LLM), [STT again] = checked
-on Trans channel = [send SRT] checked
- on Synchronizing = [dubb speedup] checked, [slow video] not checked, [no subs] selected
- dubb rate = 0, [restore punctuation cn/en] selected, [speaker diarization] not checked
final result file has only few seconds of audio and the rest has no sound
any suggestion on the issue on how to fix it?