Development and application of massive unstructured big data retrieval technology based on cloud computing platform

摘要

In view of the large data volume and complex structure of big data in the operation of major systems, the traditional cloud computing distributed multi-layer architecture data retrieval method has been difficult to meet the needs of big data retrieval. Therefore, related research must be centered around the structure of complex big data is unfolded, especially unstructured big data, to shape a new data cluster infrastructure. The cluster environment needs to implement stable retrieval of unstructured data through a cloud-centric method. The system introduces an unstructured big data retrieval framework as an unstructured database, as a data retrieval engine to improve the cloud computing big data non-structure retrieval service, and obtain the key code of unstructured big data under the retrieval technology. Finally, the system is applied to the exsperimental system, and an experimental unstructured big data integration system is built to realize the unified retrieval of large-scale different business functions and business data, so as to satisfy the users to quickly retrieve from a large number of heterogeneous business systems and massive data. Claim. Through search engine technology, the use of text mining, natural language processing, information retrieval and other fields of technology to further improve the precision and recall rate of full-text search. The application of this technology can meet the needs of unified retrieval of large-scale different business data; and at the same time meet the rapid response requirements of large-scale data retrieval requests. The experimental results show that the designed system has high precision and low retrieval time in the process of retrieving unstructured big data under cloud computing, which can realize the stable retrieval of unstructured cloud data.