首页>
外国专利>
Using machine-learning models to determine movements of a mouth corresponding to live speech
Using machine-learning models to determine movements of a mouth corresponding to live speech
展开▼
机译:使用机器学习模型来确定与实时语音相对应的嘴巴运动
展开▼
页面导航
摘要
著录项
相似文献
摘要
Disclosed systems and methods predict visemes from an audio sequence. A viseme-generation application accesses a first set of training data that includes a first audio sequence representing a sentence spoken by a first speaker and a sequence of visemes. Each viseme is mapped to a respective audio sample of the first audio sequence. The viseme-generation application creates a second set of training data adjusting a second audio sequence spoken by a second speaker speaking the sentence such that the second and first sequences have the same length and at least one phoneme occurs at the same time stamp in the first sequence and in the second sequence. The viseme-generation application maps the sequence of visemes to the second audio sequence and trains a viseme prediction model to predict a sequence of visemes from an audio sequence.
展开▼