INSTRUMENT AND METHOD FOR MEASURING SUBWORD LANGUAGE MODEL COMPLEXITY

摘要

PPROBLEM TO BE SOLVED: To measure the complexity of subword language model on which complexity of a subword unit is reflected. PSOLUTION: This subword language model complexity measuring instrument is provided with a storing means for storing a subword language model MSBSL/SBand a text line wSB1/SBSPT/SP, a conditioned complexity calculating means for calculating complexity to the text line wSB1/SBSPT/SPand to a subword sequence sSB1/SBSPZ/SPcorresponding to the text line wSB1/SBSPT/SPin the subword language model MSBSL/SBand outputting the calculation result as conditioned complexity U (wSB1/SBSPT/SP, sSB1/SBSPZ/SP¾ MSBSL/SB), a self-complexity calculating means for calculating the complexity of the subword language model MSBSL/SBitself and outputting this calculation result as self-complexity U (MSBSL/SB), and a complexity calculating means for calculating a function f (U(wSB1/SBSPT/SP, sSB1/SBSPZ/SP¾ MSBSL/SB), U(MSL)) obtained by adopting the conditioned complexity U (wSB1/SBSPT/SP, sSB1/SBSPZ/SP¾ MSBSL/SB) outputted by the conditioned complexity calculating means and the self-complexity U (MSBSL/SB) outputted by the self-complexity calculating means as input values and outputting this calculation result. PCOPYRIGHT: (C)2006,JPO&NCIPI