首页> 外国专利> META COOPERATIVE TRAINING PARADIGMS

META COOPERATIVE TRAINING PARADIGMS

机译:元合作培训范式

摘要

Generative adversarial models have several benefits; however, due to mode collapse, these generators face a quality-diversity trade-off (i.e., the generator models sacrifice generation diversity for increased generation quality). Presented herein are embodiments that improve the performance of adversarial content generation by decelerating mode collapse. In one or more embodiments, a cooperative training paradigm is employed where a second model is cooperatively trained with the generator and helps efficiently shape the data distribution of the generator against mode collapse. Moreover, embodiments of a meta learning mechanism may be used, where the cooperative update to the generator serves as a high-level meta task and which helps ensures the generator parameters after the adversarial update stay resistant against mode collapse. In experiments, tested employments demonstrated efficient slowdown of mode collapse for the adversarial text generators. Overall, embodiments outperformed the baseline approaches with significant margins in terms of both generation quality and diversity.
机译:生成的对抗性模型有几个好处;然而,由于模式崩溃,这些发电机面临质量分集权衡(即,发电机模型牺牲生成多样性以增加产生质量)。本文呈现的是通过减速模式塌陷改善对抗性含量产生的性能的实施方案。在一个或多个实施例中,采用合作训练范例,其中第二模型与发电机合作地接受,并且有助于有效地塑造发电机的数据分布反对模式崩溃。此外,也可以使用元学习机制的实施方案中,其中所述合作的更新到发电机用作高级元任务和这有助于对抗更新住宿针对模式抗塌陷后保证了发电机参数。在实验中,测试的就业人数表明了对抗文本发电机的模式崩溃的有效减速。总体而言,实施例优于在代质量和多样性方面具有显着边值的基线方法。

著录项

  • 公开/公告号US2021241099A1

    专利类型

  • 公开/公告日2021-08-05

    原文格式PDF

  • 申请/专利权人 BAIDU USA LLC;

    申请/专利号US202017136054

  • 发明设计人 DINGCHENG LI;HAIYAN YIN;XU LI;PING LI;

    申请日2020-12-29

  • 分类号G06N3/08;G06N3/04;

  • 国家 US

  • 入库时间 2022-08-24 20:20:31

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号