Automatic Cluster Parallelization and Minimizing Communication via Selective Data Replication
Sanket Tavarageri, Benoît Meister, Muthu Baskaran, Benoît Pradelle, Tom Henretty, Athanasios Konstantinidis, Ann Johnson, Richard Lethin
Publication Source: IEEE Conference on High Performance Extreme Computing (HPEC), Waltham, MA, USA, 2015
The technology scaling has initiated two distinct trends that are likely to continue into future: first, the increased parallelism in hardware and second, the increasing performance and energy cost of communication relative to computation. Both of the above trends call for development of compiler and runtime systems to automatically parallelize programs and reduce communication in parallel computations to achieve the desired high performance in an energy-efficient fashion.