首页> 外文会议>Workshop for NLP Open Source Software >CLEVR Parser: A Graph Parser Library for Geometric Learning on Language Grounded Image Scenes
【24h】

CLEVR Parser: A Graph Parser Library for Geometric Learning on Language Grounded Image Scenes

机译:CLEVR解析器:语言接地图像场景的几何学习的图形解析器库

获取原文

摘要

The CLEVR dataset has been used extensively in language grounded visual reasoning in Machine Learning (ML) and Natural Language Processing (NLP) domains. We present a graph parser library for CLEVR, that provides functionalities for object-centric attributes and relationships extraction, and construction of structural graph representations for dual modalities. Structural order-invariant representations enable geometric learning and can aid in downstream tasks like language grounding to vision, robotics, compositional-ity, interpretability, and computational grammar construction. We provide three extensible main components - parser, embedder, and visualizer that can be tailored to suit specific learning setups. We also provide out-of-the-box functionality for seamless integration with popular deep graph neural network (GNN) libraries. Additionally, we discuss downstream usage and applications of the library, and how it accelerates research for the NLP research community.
机译:CLEVR数据集已广泛用于机器学习(ML)和自然语言处理(NLP)域中的语言接地视觉推理。我们为CLEVR提出了一个图形解析器库,为对象​​的属性和关系提取提供功能,以及双重方式的结构图表示的构建。结构订单不变表示使几何学习能够帮助下游任务,如语言接地,机器人,组成 - ITY,解释性和计算语法建设。我们提供三个可扩展的主要组件 - Parser,Embedder和可视化器,可以根据特定的学习设置量身定制。我们还提供了与流行深图神经网络(GNN)库的无缝集成的开箱功能。此外,我们讨论了图书馆的下游使用和应用,以及如何加速对NLP研究界的研究。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号