METHOD AND SYSTEM FOR INTEGRATING DATA FROM DIFFERENT DATA SOURCES INTO A KNOWLEDGE GRAPH STORAGE UNIT

摘要

The present invention relates to a method for integrating data from different data sources (210, 220, 230, 240, 250) into a knowledge graph storage unit (300), comprising (a) transferring (S10) data from different data sources (210, 220,230,240, 250) into a receiving and extraction module (410) of an extraction-transformation-loading, ETL, data pipeline framework (400); (b) extracting (S20) the loaded data in the receiving and extraction module (410) by using an extraction data frame and transferring the extracted data to a transformation module (420) of the ETL data pipeline framework (400); (c) transforming (S30) the extracted data in the trans- formation module (420) by using transformation functionalities and transferring the transformed data to a mapping module (430) of the ETL data pipeline framework (400); (d) mapping (S40) the transformed data in the mapping module (430) by using mapping rule functionalities and transferring the mapped data to a post-processing module (440) of the ETL data pipeline framework (400); (e) post-processing the mapped data in the post- processing module (440) by using a library and transferring the post-processed data to a loading module (450) of the ETL data pipeline framework (400); and (f) loading the processed data by the loading module (450) to the knowledge graph storage unit (300); wherein the mapping module (430) uses a JSON-based mapping notation to convert the transformed data into a serialized form.