博通公司近日发布了一款人工智能芯片组,能够直接在设备上实现音频实时翻译。

内容总结:
近日,博通公司宣布推出一款新型人工智能芯片,可实现设备端实时音频翻译及屏幕内容描述功能。该技术由博通与人工智能企业CAMB.AI共同研发,首次将无需云端支持的实时翻译与配音能力集成至芯片级解决方案。
据悉,这款系统级芯片(SoC)具备三大突破性优势:一是通过本地化处理实现超低延迟,有效保障用户隐私;二是大幅降低无线带宽依赖;三是支持超过150种语言的实时转换。在公开演示中,该芯片成功对动画片《料理鼠王》片段实现了多语言场景描述与字幕生成,展现出为视障群体提升信息无障碍服务的潜力。
不过目前展示效果基于精心剪辑的片段,实际应用中的准确性与适应性仍有待验证。尽管该语音模型已获纳斯卡、康卡斯特及欧洲歌唱大赛等机构采用,芯片正式投入商用尚无明确时间表。值得关注的是,博通近期还与OpenAI达成芯片制造合作,持续深化在AI硬件领域的布局。
(注:根据中文新闻报道习惯,对企业名称采用通用译名“博通”,并对技术表述进行了符合中文语境的优化重组。)
中文翻译:
博通公司最新发布了一款人工智能芯片组,能够直接在设备上实现音频实时翻译功能。该技术无需依赖云端连接,同时还可实现屏幕内容语音描述功能。
博通与人工智能企业CAMB.AI正展开合作,将设备端音频翻译技术集成至芯片组。搭载该片上系统的设备可独立完成翻译、配音及音频描述任务,无需借助云端处理。这意味着消费者无障碍使用体验将获得革命性提升。
由于所有数据处理均在用户设备本地完成,两家公司承诺实现超低延迟与强化隐私保护,无线带宽占用也将大幅降低。
在音频描述功能演示中,技术团队使用电影《料理鼠王》片段进行展示。人工智能系统不仅能以多种语言实时描述场景内容,还同步提供屏幕文字翻译。这项技术对存在视觉障碍的用户群体具有显著实用价值。
需要特别说明的是,当前演示片段经过精密剪辑处理。该技术在实际场景中的运行效果尚属未知,其信息准确性也有待验证。不过值得注意的是,该系统采用的语音模型已被纳斯卡赛车、康卡斯特电信和欧洲歌唱大赛等国际机构采用。
两家公司宣称该技术将支持"150多种语言的设备端即时翻译"。目前芯片何时搭载至电视等智能设备尚未明确,相关技术仍处于测试阶段,正式商用仍需时日。值得关注的是,博通近期还与OpenAI达成合作,将为后者提供定制芯片制造支持。
英文来源:
Broadcom just announced an AI chipset that translates audio in real time directly on the device
It won't need any cloud connectivity and it also can do descriptions of what's on the screen.
Broadcom and a company called CAMB.AI are teaming up to bring on-device audio translation to a chipset. This would allow devices that use the SoC to complete translation, dubbing and audio description tasks without having to dip into the cloud. In other words, it could massively improve accessibility for consumers.
The companies promise ultra-low latency and enhanced privacy, being that all processing is kept local to the user's device. The wireless bandwidth should also be drastically reduced.
As for the audio description piece, there's a demo video of the tool being used on a clip from the film Ratatouille. The AI can be heard describing the scene in various languages, in addition to a written translation appearing on-screen. This looks incredibly useful, particularly for those with vision issues.
There is a major caveat. This is a tightly controlled clip with plenty of edits. We have no idea how this tech will work in a real world scenario. Also, we don't know how accurate the information will be. It does feature a voice model that's already being used by organizations like NASCAR, Comcast and Eurovision.
The companies boast that this will enable "on-device translation in over 150 languages." We don't know when these chips will begin showing up in TVs and other gadgets. The tech is in the testing phase for now, so it's gonna be a while. Broadcom also recently teamed up with OpenAI to help the latter company to manufacture its own chips.
文章标题:博通公司近日发布了一款人工智能芯片组,能够直接在设备上实现音频实时翻译。
文章链接:https://qimuai.cn/?post=1992
本站文章均为原创,未经授权请勿用于任何商业用途