首页> 外文学位 >Real-time Human Interaction with Supervised Learning Algorithms for Music Composition and Performance.
【24h】

Real-time Human Interaction with Supervised Learning Algorithms for Music Composition and Performance.

机译:实时的人与人交互以及受监督的音乐创作和表演学习算法。

获取原文
获取原文并翻译 | 示例

摘要

This thesis examines machine learning through the lens of human-computer interaction in order to address fundamental questions surrounding the application of machine learning to real-life problems, including: Can we make machine learning algorithms more usable and useful? Can we better understand the real-world consequences of algorithm choices and user interface designs for end-user machine learning? How can human interaction play a role in enabling users to efficiently create useful machine learning systems, in enabling successful application of algorithms by machine learning novices, and in ultimately making it possible in practice to apply machine learning to new problems?;The scope of the research presented here is the application of supervised learning algorithms to contemporary computer music composition and performance. Computer music is a domain rich with computational problems requiring the modeling of complex phenomena, the construction of real-time interactive systems, and the support of human creativity. Though varied, many of these problems may be addressed using machine learning techniques, including supervised learning in particular. This work endeavors to gain a deeper knowledge of the human factors surrounding the application of supervised learning to these types of problems, to make supervised learning algorithms more usable by musicians, and to study how supervised learning can function as a creative tool.;This thesis presents a general-purpose software system for applying standard supervised learning algorithms in music and other real-time problem domains. This system, called the Wekinator, supports human interaction throughout the entire supervised learning process, including the generation of training examples and the application of trained models to real-time inputs. The Wekinator is published as a freely-available, open source software project, and several composers have already employed it in the creation of new musical instruments and compositions.;This thesis also presents work utilizing the Wekinator to study human-computer interaction with supervised learning in computer music. Research is presented which includes a participatory design process with practicing composers, pedagogical use with non-expert users in an undergraduate classroom, a study of the design of a gesture recognition system for a sensor-augmented cello bow, and case studies with three composers who have used the system in completed artistic works.;The primary contributions of this work include (1) a new software tool allowing real-time human interaction with supervised learning algorithms, which includes a novel "playalong" interaction for generating training data in real-time; (2) a demonstration of the important roles that interaction|encompassing both human-computer control and computer-human feedback|can play in the development of supervised learning systems, and a greater understanding of the differences between interactive and conventional machine learning contexts; (3) a better understanding of the requirements and challenges in the analysis and design of algorithms and interfaces for interactive supervised learning in real-time and creative problem domains; (4) a clearer characterization of composers' goals and priorities for interacting with computers in music composition and instrument design; and (5) a demonstration of the usefulness of interactive supervised learning as a creativity support tool. This work both empowers musicians to create new forms of art and contributes to a broader HCI perspective on machine learning practice.
机译:本论文从人机交互的角度研究了机器学习,以解决围绕将机器学习应用于实际问题的基本问题,其中包括:我们能否使机器学习算法更有用和有用?我们能否更好地理解算法选择和用户界面设计对最终用户机器学习的现实后果?人机交互如何在使用户有效创建有用的机器学习系统,使机器学习新手成功应用算法以及最终在实践中将机器学习应用于新问题方面发挥作用?本文介绍的研究是有监督的学习算法在当代计算机音乐创作和演奏中的应用。计算机音乐是一个涉及计算问题的领域,需要对复杂现象进行建模,实时交互系统的构建以及人类创造力的支持。尽管这些问题多种多样,但可以使用机器学习技术来解决其中许多问题,尤其是监督学习。这项工作旨在加深对将监督式学习应用于这类问题的人为因素的了解,使音乐家更容易使用监督式学习算法,并研究监督式学习如何作为一种创新工具。提出了一种通用软件系统,用于在音乐和其他实时问题领域中应用标准的监督学习算法。这个称为Wekinator的系统在整个有监督的学习过程中支持人与人之间的互动,包括生成训练示例并将训练后的模型应用于实时输入。 Wekinator是作为免费提供的开源软件项目发布的,并且一些作曲家已经将其用于新乐器和乐曲的创作中。本论文还介绍了利用Wekinator来研究人机交互与监督学习的工作。在计算机音乐中。提出的研究包括与作曲家共同参与的设计过程,与非专业用户在大学教室中的教学使用,对传感器增强的大提琴弓的手势识别系统设计的研究以及与三位作曲家的案例研究已在完成的艺术作品中使用了该系统。;这项工作的主要贡献包括:(1)一种新的软件工具,该工具可以与有监督的学习算法进行实时的人机交互,其中包括一种新颖的“玩伴”交互功能,可以实时生成训练数据。时间; (2)演示了在监督学习系统的开发中,人机控制和人机反馈两者相互作用的重要作用,以及对交互式和传统机器学习环境之间差异的更深入的理解; (3)更好地理解实时和创造性问题领域中的交互式监督学习的算法和接口的分析和设计的要求和挑战; (4)更清晰地描述作曲家在音乐创作和乐器设计中与计算机进行交互的目标和优先顺序; (5)演示交互式监督学习作为创造力支持工具的有用性。这项工作既使音乐家有能力创造新的艺术形式,又为人机交互领域对机器学习实践的广阔视野做出了贡献。

著录项

  • 作者

    Fiebrink, Rebecca Anne.;

  • 作者单位

    Princeton University.;

  • 授予单位 Princeton University.;
  • 学科 Music.;Computer Science.
  • 学位 Ph.D.
  • 年度 2011
  • 页码 413 p.
  • 总页数 413
  • 原文格式 PDF
  • 正文语种 eng
  • 中图分类
  • 关键词

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号