Language model creation method, language model creation device, and language model creation program

摘要

PPROBLEM TO BE SOLVED: To create a language model and split a word without using teacher data. PSOLUTION: A language mode creation device selects a plurality of sentences stored in character string data 131 at random, and creates a character string splitting pattern group indicating a character string as a word punctuation candidate in the selected sentences using the language model 132. The probability of the sentence corresponding to the character string splitting pattern of the character string splitting pattern group is recorded in a storage, and a character string pattern is selected among the character string splitting pattern groups based on the probability. The language model 132 is updated using the selected character string splitting pattern. Such a process is executed to all the sentences stored in the character string data 131, and the language model 132 is optimized. Using the language model 132 optimized in such a manner, split of a most likelihood word of the sentence is performed. PCOPYRIGHT: (C)2010,JPO&INPIT