Context aware discovery in web data through anomaly detection

摘要

Context enables more accurate searches on the enormous information available on the web by setting the boundaries within which we can transition from data to relevant information. This paper describes a technique to analyse data extracted from the web and generate a contextual model that seamlessly combines data elements of a domain to provide the most accurate information to the user. The discovery of anomalies is of particular interest, since they may not be clearly evident without context information of a specific domain. A generic system design for extracting web data and generating a contextual model for any domain is presented. Contextual information and semantic techniques are used in a prototype system for the identification of potential threats associated with cargo shipments from the contextual perspective of relevant US federal agencies. An experimental evaluation shows that this technique increases precision of results.