Data parallel language and compiler support For data intensive applications

摘要

Processing and analyzing large volumes of data plays an increasingly important role in Many domains of scientific research. High-level language and compiler support for developing Applications that analyze and process such datasets has, however, been lacking so far. In this paper, we present a set of language extensions and a prototype compiler for support- Ing high-level object-oriented programming of data intensive reduction operations over mul- tidimensional data. We have chosen a dialect of Java with data-parallel extensions for Specifying a collection of objects, a parallel for loop, and reduction variables as our source High-level language. Our compiler analyzes parallel loops and optimizes the processing of da- tasets through the use of an existing run-time system, called active data repository(ADR).