Efficient Communication Across the Internet in Wide-Area MPI

摘要

In this paper, we present a highly customized, user-level communication protocol called the Wide-Area MPI Protocol (WAMP), developed as an alternative to the TCP/IP protocols for communication across the Internet in wide-area MPI. We discuss the design of WAMP, and present experimental results showing up to a nine-fold improvement in performance over TCP/IP in a heavily loaded network. However, TCP/IP outperforms WAMP by up to a factor of three in a lightly loaded network environment. These results lead us to believe that the best solution for wide-area MPI is an adaptive communication protocol that can switch between TCP/IP and WAMP based on the current network conditions.