Method for translating multi modal execution dependency graph with data interdependencies to efficient application on homogenous big data processing platform

摘要

This invention relates to a method and system for creating applications that can be executed on homogeneous big data platforms. The applications can be executed on a particular platform, such as SAPRK or UIMA-AS, but the method and system are able to translate the input to these targeted platforms without the developer needing to tailor the application specifically to the platform. The method and system are based on the use of an execution dependency graph and a cluster configuration. The execution dependency graph can include interdependencies in the data. Furthermore, the system optimizes for different analytics modules that have varying execution times. The output of the method is an application suitable for the target big data platform.