基于布鲁姆过滤器的文本检索系统研究

摘要

针对目前文本检索系统出现的信息重复，冗余等问题，提出了一种将布鲁姆过滤器算法与MD5有效结合的方案。对检索关键字进行ND5预处理操作，充分利用MD5的可靠性。并发挥鲁姆过滤器降低检索算法的时间复杂度和空间复杂度的特点，大大提高了检索的快速性，相关性和完备性。%Aiming at the characteristics of information duplication and redundancy in Text Retrieval System, a solution to effectively combine the Bloom Filter algorithm and MD5 was proposed. In order to make full use of MD5 reliability, key words pre-processing was very necessary. Benefiting from the characteristics that Bloom Filter can reduce the space complexity and time complexity, the solution greatly improves the efficiency, and the correlation and completeness of retrieval.