| Abstract:
Open MPI is a project recently initiated to provide a
fault-tolerant, multi-network capable, and production-quality
implementation of MPI-2 interface based on experiences
gained from FT-MPI, LA-MPI, LAM/MPI, and MVAPICH projects.
Its initial communication architecture is layered on top
of TCP/IP. In this project, we have designed and implemented
Open MPI point-to-point layer on top of a high-end interconnect,
Quadrics/Elan4. Design challenges related to dynamic process/connection
management, utilizing Quadrics RDMA capabilities and supporting
asynchronous communication progression are overcome with
salient strategies to utilize Quadrics Queued-based Direct
Memory Access (QDMA) and Remote Direct Memory Access (RDMA)
operations, along with the chained event mechanism.
Experimental results indicate
that the resulting point-to-point transport layer implementation
is able to achieve comparable performance to Quadrics
native QDMA operations, from which it is derived. While
not taking advantages of Quadrics/Elan4 NIC-based tag
matching due to its design requirements, this point-to-point
transport layer provides a high performance implementation
of MPI-2 compliant message passing over Quadrics/Elan4. |