Semantic Knowledge Acquisition from Blogs with Tag-Topic Model

摘要

This paper focuses on semantic knowledge acquisition from blogs with the proposed tag-topic model.The model extends the Latent Dirichlet Allocation(LDA) model by adding a tag layer between the document and the topic.Each document is represented by a mixture of tags;each tag is associated with a multinomial distribution over topics and each topic is associated with a multinomial distribution over words.After parameter estimation,the tags are used to describe the underlying topics.Thus the latent semantic knowledge within the topics could be represented explicitly.The tags are treated as concepts,and the top-N words from the top topics are selected as related words of the concepts.Then PMI-IR is employed to compute the relatedness between each tag-word pair and noisy words with low correlation removed to improve the quality of the semantic knowledge.Experiment results show that the proposed method can effectively capture semantic knowledge,especially the polyseme and synonym.