基于统计和浅层语言分析的维吾尔文语义串快速抽取

摘要

该文提出了一种基于统计和浅层语言分析的维吾尔文语义串快速抽取方法,采用一种多层动态索引结构为大规模文本建词索引,结合维吾尔文词间关联规则采用一种改进的n元递增算法进行词串扩展并发现文本中的可信频繁模式,最终依次判断频繁模式串结构完整性从而得到语义串.通过在不同规模的语料上实验发现,该方法可行有效,能够应用到维吾尔文文本挖掘多个领域.%A fast Uyghur semantic string extraction method is proposed based on statistical model and shallow lin-guistic parsing .It employs a multilayered dynamic indexing structure to build word index for large-scale text .Com-bined with the Uyghur word association rules ,an improved n-gram incremental algorithm is designed for word string extension ,trying to capture the credible frequent patterns in the text .The final semantic strings are determined af-ter the structural integrity of the frequent pattern is verified .Experiments on different corpus indicate that this method is feasible and effective .