EDM-JBW: A novel event detection model based on JS-ID'F_(order) and Bikmeans with word embedding for news streams

摘要

Due to the popularity of Internet, news streams are overflowing every day, so people struggle to capture the underlying hot events in news streams. Discovering the hot events from numerous news documents has become an urgent problem. However, existing works of this problem only use traditional Term Frequency x Inverse Document Frequency to select text features and text representations, and some do not consider the time order. In this paper, we propose a novel event detection model called EDM-JBW. This model utilizes Jaccard Similarity coefficient x Inverse Dimension Frequency with time order, Le.,JS-ID'F-order, based on word2vec to represent document embedding, and uses Bikmeans to cluster all news documents into news events. The experimental evaluation on three real datasets shows that our techniques outperform the baseline techniques. (C) 2017 Published by Elsevier B.V.