We present a retrospective on collecting data of human interactions with multimodal dialog systems ("dialog data") using crowdsourcing techniques. This is largely based on our experience using the HALEF multimodal dialog system to deploy education-domain conversational applications on the Amazon Mechanical Turk crowdsourcing platform. We list the various lessons learned from this endeavor over two years and make recommendations on best practices to be followed by practitioners and researchers looking to crowdsource dialog data for a new domain.
展开▼
机译：我们使用众包技术提出了与多模式对话系统（“对话数据”）收集人为交互数据的回顾。这主要基于我们使用Halef Multimodal对话系统的经验，在Amazon Mechanical Turk Crowdsourcing平台上部署教育域会话应用程序。我们列出了两年多的努力中汲取的各种经验教训，并提出了关于最佳实践的建议，然后是从业者和研究人员寻找新域的人群对话数据。
展开▼
