Contention-free Scheduling of Communication Induced by Array Operations on 2D Meshes

• Main Author: Eberhart, Andreas Bernhard Georg
• Format: Others
• Published: PDXScholar 1996
• Subjects: Parallel processing (Electronic computers) > Mathematical models; Computer algorithms; Computer Sciences
• Online Access: https://pdxscholar.library.pdx.edu/open_access_etds/5077; https://pdxscholar.library.pdx.edu/cgi/viewcontent.cgi?article=6147&context=open_access_etds

Whole array operations and array section operations are important features of many data-parallel languages. Efficient implementation of these operations on distributed- memory multicomputers is critical to the scalability and high-performance of data-parallel programs. This thesis presents an approach for analyzing communication patterns induced by array operations and for using run-time information to schedule the message flow. The distributed, dynamic scheduling algorithms guarantee link-contention-free data transfer and utilize network resources almost optimally. They incur little overhead, which is important in order not to reduce the speedup gained by the parallel execution. The algorithms can be used by compilers for the generation of efficient code for array operations. Implemented in a runtime library, they can derive a schedule depending on parameters passed by the parallel application. Simulation results demonstrate the algorithms' superiority to the asynchronous transfer mode that is commonly used for this type of communication.