#5728 CUDA error: device-side assert triggeredCompile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.

192.220* Posted at: 1 hour ago

CUDA error: device-side assert triggered
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.
,Traceback (most recent call last):
File "videotrans\process\tts_fun.py", line 90, in qwen3tts_fun
File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "D:\win-pyvideotrans\_internal\qwen_tts\inference\qwen3_tts_model.py", line 829, in generate_custom_voice

talker_codes_list, _ = self.model.generate(

File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "D:\win-pyvideotrans\_internal\qwen_tts\core\models\modeling_qwen3_tts.py", line 2272, in generate

talker_result = self.talker.generate(

File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "transformers\generation\utils.py", line 2566, in generate

result = decoding_method(

File "transformers\generation\utils.py", line 2789, in _sample

......
ed_call_impl

return self._call_impl(*args, **kwargs)

File "torch\nn\modules\module.py", line 1762, in _call_impl

return forward_call(*args, **kwargs)

File "transformers\utils\generic.py", line 918, in wrapper

output = func(self, *args, **kwargs)

File "D:\win-pyvideotrans\_internal\qwen_tts\core\models\modeling_qwen3_tts.py", line 1671, in forward

predictor_result = self.code_predictor.generate(

File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "transformers\generation\utils.py", line 2566, in generate

result = decoding_method(

File "transformers\generation\utils.py", line 2831, in _sample

next_tokens = torch.multinomial(probs, num_samples=1).squeeze(1)

RuntimeError: CUDA error: device-side assert triggered
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

Traceback (most recent call last):
File "videotrans\task\only_one.py", line 86, in run
File "videotrans\task\_stage_dubbing.py", line 23, in dubbing
File "videotrans\task\_stage_dubbing.py", line 102, in _tts
File "videotrans\tts\__init__.py", line 207, in run
File "videotrans\tts\_base.py", line 93, in run
File "videotrans\tts\_qwenttslocal.py", line 46, in _exec
File "videotrans\configure\base.py", line 272, in _new_process
videotrans.configure.excepts.VideoTransError: CUDA error: device-side assert triggered
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.
,Traceback (most recent call last):
File "videotrans\process\tts_fun.py", line 90, in qwen3tts_fun
File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "D:\win-pyvideotrans\_internal\qwen_tts\inference\qwen3_tts_model.py", line 829, in generate_custom_voice

talker_codes_list, _ = self.model.generate(

File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "D:\win-pyvideotrans\_internal\qwen_tts\core\models\modeling_qwen3_tts.py", line 2272, in generate

talker_result = self.talker.generate(

File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "transformers\generation\utils.py", line 2566, in generate

result = decoding_method(

File "transformers\generation\utils.py", line 2789, in _sample

outputs = model_forward(**model_inputs, return_dict=True)

File "torch\nn\modules\module.py", line 1751, in _wrapped_call_impl

return self._call_impl(*args, **kwargs)

File "torch\nn\modules\module.py", line 1762, in _call_impl

return forward_call(*args, **kwargs)

File "transformers\utils\generic.py", line 918, in wrapper

output = func(self, *args, **kwargs)

File "D:\win-pyvideotrans\_internal\qwen_tts\core\models\modeling_qwen3_tts.py", line 1671, in forward

predictor_result = self.code_predictor.generate(

File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "transformers\generation\utils.py", line 2566, in generate

result = decoding_method(

File "transformers\generation\utils.py", line 2831, in _sample

next_tokens = torch.multinomial(probs, num_samples=1).squeeze(1)

RuntimeError: CUDA error: device-side assert triggered
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

cfg=[TaskCfgVTT]当前工作模式: 翻译视频或音频 单视频模式
原始输入文件名: E:/直播素材/douyin_80017709309__2026-07-09T04-26-14-790Z.mp4,
输出结果保存到文件夹: E:/直播素材/douyin_80017709309__2026-07-09T04-26-14-790Z-mp4,
临时文件夹: D:/win-pyvideotrans/tmp/25500/38fb8e3b6e
已选 清理已存在
已选 启用CUDA加速
未选 降噪
语音识别:阿里FunASR(本地内置), model_name: Fun-ASR-Nano-2512, 发音语言: 简体中文, 断句方式:默认断句
翻译渠道:Google(免费),原始语言:简体中文,目标语言:英语, 已选 发送完整字幕
配音渠道:Qwen3-TTS(本地内置), 角色:Serena, 配音语言:英语, 未选 二次语音识别
音量:+0%, 语速:+0%, 已选 音频加速, 未选 视频慢速
字幕: 嵌入硬字幕
代理地址:


=
system:Windows-10-10.0.19045-SP0
version:v4.04
frozen:True
language:zh
root_dir:D:/win-pyvideotrans

5 Replies

这个错误是由于 CUDA 设备端断言失败(device-side assert triggered),通常是由显存不足CUDA/cuDNN 环境不匹配模型文件损坏导致。你的显卡显存可能不足以运行 Qwen3-TTS 模型,或 CUDA 版本不符合要求(需要 12.8+ 且 cuDNN 9.11+)。

解决方案:

  1. 临时绕过:在软件主界面取消勾选“CUDA 加速”,改用 CPU 运行(速度慢但可正常工作)。
  2. 检查 CUDA 环境:确保已正确安装 CUDA 12.8+ 和 cuDNN 9.11+,并确认 nvcc -Vnvidia-smi 输出匹配。
  3. 降低模型精度:进入 菜单 -> 工具 -> 高级选项 -> 语音识别参数,将“计算数据类型”设为 int8(最省显存)或 float16
  4. 尝试其他配音渠道:使用更轻量的免费渠道如 Edge-TTS(无需 GPU),或本地 ZipVoice(显存需求低)。
  5. 重新下载模型:删除软件目录下 models/models--Qwen--Qwen3-TTS-xx... 文件夹(或类似路径),让软件下次重新下载模型,防止文件损坏。

如果以上仍无法解决,请提供你的显卡型号、显存大小以及 nvidia-smi 输出片段以便进一步诊断。

请查阅相关文档:

显卡RTX4060 8GB,CUDA v13.2,cudnn v9.11

你的硬件配置(RTX 4060 8GB,CUDA 13.2,cuDNN 9.11)理论上满足 Qwen3-TTS 的 GPU 加速要求,但 "device-side assert triggered" 通常是 显存不足或模型文件损坏 导致的 GPU 内部错误。由于同时使用了 FunASR 语音识别(也要占用显存),很可能是两者叠加导致 8GB 显存达到极限。


解决方案(按推荐顺序尝试)

  1. 关闭 CUDA 加速,用 CPU 运行(立即可行)

    • 在主界面取消勾选“CUDA 加速”,让 Qwen3-TTS 和 FunASR 都用 CPU 计算。
    • 代价:速度明显下降,但能正常工作。
  2. 降低显存占用(保留 CUDA)

    • 进入 菜单 → 工具 → 高级选项 → 语音识别参数,将“计算数据类型”设为 int8(最省显存)。
    • 将 ASR 模型切换为更轻量的 faster-whisper(本地内置) + tinysmall 模型(FunASR 的 Nano 版本身显存需求中等,但配合 TTS 仍可能超限)。
    • 确保只运行一个任务:关闭其他占用 GPU 的程序(如浏览器、游戏)。
  3. 重新下载 Qwen3-TTS 模型(防止文件损坏)

    • 关闭软件,删除 models/ 目录下所有 qwenQwen3-TTS 开头的文件夹。
    • 重新启动软件,在配音渠道中选择 Qwen3-TTS(本地内置),软件会重新下载模型。
  4. 更换更省显存的配音渠道

    • 如果上述仍无效,建议改用 Edge-TTS(免费,不需要 GPU)ZipVoice(本地内置,显存需求极低)
    • 修改配音渠道为 Edge-TTS,选择对应英语角色(如 en-US-GuyNeural)即可。
  5. 升级显卡驱动

    • 确保你的 NVIDIA 驱动版本支持 CUDA 13.2(驱动版本 ≥ 545.x 即可)。前往 NVIDIA 官网 更新驱动到最新。

如果想彻底诊断问题根源

请打开 logs/ 目录下最新日期的日志文件,搜索关键词 CUDA errorout of memory,如果看到 RuntimeError: CUDA out of memory 则是显存不足;若无明显显存报错,则多为模型损坏或驱动兼容性问题。

日志文件内容如下,请分析:


Application started at 2026-07-09 09:50:17

1783561817:Loading resources...
1783561817:Loading main window...
1783561817:Initializing UI...
1783561817:SetupUI end...
1783561817:import recognition ...
1783561817:import tts ...
1783561817:import translate ...
1783561817:Get cache ...
1783561817:Set default value ...
1783561817:import voices list ...
1783561817:Set tts voice ...
[DEBUG] 上次缓存的角色:Serena,字幕嵌入类型:1,发音语言:简体中文,目标语言:英语,目标语言代码:en,模型:Fun-ASR-Nano-2512,TTS渠道[1]
1783561817:show main window ...
1783561817:Bind signal...
1783561817:set cursor...
1783561817:preload TTS win...
1783561817:preload STT win...
1783561817:preload translate srt win...
1783561817:end
[DEBUG] 可用 Nvidia 显卡数: 1
[DEBUG] 找到 1 个 Nvidia GPUs, 耗时: 6s
[DEBUG] 返回缓存的编解码器 Windows-264: h264_nvenc
[DEBUG] 返回缓存的编解码器 Windows-265: hevc_nvenc

[DEBUG] start 9 jobs
[DEBUG] app_cfg.pro
......
t = self.code_predictor.generate(
File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "transformers\generation\utils.py", line 2566, in generate

result = decoding_method(

File "transformers\generation\utils.py", line 2831, in _sample

next_tokens = torch.multinomial(probs, num_samples=1).squeeze(1)

RuntimeError: CUDA error: device-side assert triggered
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

Traceback (most recent call last):
File "videotrans\task\only_one.py", line 86, in run
File "videotrans\task\_stage_dubbing.py", line 23, in dubbing
File "videotrans\task\_stage_dubbing.py", line 102, in _tts
File "videotrans\tts\__init__.py", line 207, in run
File "videotrans\tts\_base.py", line 93, in run
File "videotrans\tts\_qwenttslocal.py", line 46, in _exec
File "videotrans\configure\base.py", line 272, in _new_process
videotrans.configure.excepts.VideoTransError: CUDA error: device-side assert triggered
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.
,Traceback (most recent call last):
File "videotrans\process\tts_fun.py", line 90, in qwen3tts_fun
File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "D:\win-pyvideotrans\_internal\qwen_tts\inference\qwen3_tts_model.py", line 829, in generate_custom_voice

talker_codes_list, _ = self.model.generate(

File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "D:\win-pyvideotrans\_internal\qwen_tts\core\models\modeling_qwen3_tts.py", line 2272, in generate

talker_result = self.talker.generate(

File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "transformers\generation\utils.py", line 2566, in generate

result = decoding_method(

File "transformers\generation\utils.py", line 2789, in _sample

outputs = model_forward(**model_inputs, return_dict=True)

File "torch\nn\modules\module.py", line 1751, in _wrapped_call_impl

return self._call_impl(*args, **kwargs)

File "torch\nn\modules\module.py", line 1762, in _call_impl

return forward_call(*args, **kwargs)

File "transformers\utils\generic.py", line 918, in wrapper

output = func(self, *args, **kwargs)

File "D:\win-pyvideotrans\_internal\qwen_tts\core\models\modeling_qwen3_tts.py", line 1671, in forward

predictor_result = self.code_predictor.generate(

File "torch\utils\_contextlib.py", line 116, in decorate_context

return func(*args, **kwargs)

File "transformers\generation\utils.py", line 2566, in generate

result = decoding_method(

File "transformers\generation\utils.py", line 2831, in _sample

next_tokens = torch.multinomial(probs, num_samples=1).squeeze(1)

RuntimeError: CUDA error: device-side assert triggered
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

日志显示错误发生在 Qwen3-TTS 配音阶段,torch.multinomial 抛出 CUDA error: device-side assert triggered。此错误通常由以下原因之一引起:

  • 显存不足(RTX 4060 8GB 同时运行 FunASR 和 Qwen3-TTS 可能超限)
  • 模型文件损坏
  • CUDA/cuDNN 版本与打包的 PyTorch 不兼容(你使用的是 CUDA 13.2,软件打包的 torch 可能未针对此版本测试)

请按以下顺序排查:

  1. 临时绕过:取消主界面的“CUDA 加速”勾选,改用 CPU 运行(速度慢但可验证是否是 GPU 问题)。
  2. 降低显存占用:进入 菜单 → 工具 → 高级选项 → 语音识别参数,将“计算数据类型”设为 int8,并将 ASR 模型换为更轻量的 faster-whisper(本地内置) + tiny
  3. 重新下载 Qwen3-TTS 模型:关闭软件,删除 models/ 目录下所有 qwenQwen3-TTS 开头的文件夹,重新启动软件自动下载。
  4. 切换轻量配音渠道:改用 Edge-TTS(免费,无需 GPU)或 ZipVoice(本地内置)
  5. 更新显卡驱动:确保驱动版本 ≥ 550(支持 CUDA 13.2)。前往 NVIDIA 官网 安装最新 Game Ready 驱动。

若以上仍无效,可能是打包版 torch 与 CUDA 13.2 的兼容性 Bug,建议先使用 Edge-TTS 或 ZipVoice 完成当前任务。

Post Your Reply
Open source and free maintenance is not easy. If this project is helpful to you, please consider making a small donation to help the project continue to maintain and update. Dondate: ko-fi.com/jianchang512

Related resource