The development of a data collection and analysis system based on social network users’ data

摘要

The general concept and implementation of a practice-oriented social network data storage and analysis system are discussed in this paper. The need for such a concept comes from the fact that at the moment little attention is paid to the internal structure of such systems. The proposed system organizes the process of collecting data, filling the database from third-party sources and analyzing the collected data. The main problem of gathering fragmented data from different sources is also addressed. Due to the variety of possible information formats, approaches for designing efficient data warehouse for further social network user’s data analysis are discussed in this paper. Considered approach for design and implementation of the data collection subsystem can be used for storing user’s data with the current trends in the development of social networks. The problem of data confidentiality in such systems is also discussed. An example is provided for the implementation of the main parts of the system.