Design and Implementation of massive data retrieving based on cloud computing platform

摘要

Considering the low efficiency of massive data retrieving in traditional parallel processing, by taking advantage of the great availability of cloud computing paradigm, we propose a hybrid solution based on Map-Reduce model and distributed computing framework-Spark. Moreover, we design and implement this solution in our lab. The results show that the solution can effectively improve the performance of massive data retrieving.