Themes Discovery with a Generalized Dictionary Model

摘要

Discovery of patterns and functional modules from observed data sets is one of the most important problems in data mining and bioinformatics. In this paper, we propose an approach for discovering patterns and functional modules from categorical and text data sets.The potential patterns hidden in data sets are regarded as themes. In terms of a probabilistic model, we build a dictionary of these themes, and then we try to find these themes based on the likelihood. To evaluate the approach, we give simulation, and then we apply the approach to the traditional Chinese medicine, Chinese text mining and genome data. Compared with other approaches, the advantages of the approach proposed in this paper are that it can find smaller and weaker modules which may overlap heavily with very low false positive rate and it can present more complex relationships among variables.