LOG ANALYSIS-BASED MONGODB DATA MIGRATION MONITORING METHOD AND APPARATUS

摘要

A log analysis-based MongoDB data migration monitoring method and apparatus, relating to the field of electronic information technologies. Said method comprises: constructing a MongoDB shard cluster (S101); enabling the accumulation sum of the amount of the data subjected to secondary data migration in the MongoDB shard cluster to be within a preset threshold range (S102); acquiring dynamic splitting and migration information of historical data blocks in the MongoDB shard cluster (S103); and dividing a data migration route into different stages by taking a successful migration of the historical data blocks as a boundary, and drawing data block key value intervals of all the stages in sequence according to proportions (S104). Said method and apparatus use log data in a MongoDB configuration server, observe the existing distribution, history distribution and migration condition of data blocks between different servers, and define a write amplification estimation formula to evaluate the quality of a splitting and migration policy, and help a MongoDB database better perform pre-division and resource allocation. Compared with traditional observation methods, the present invention is not interfered by other factors, and uses historical log data, achieving an accurate result.