Low-overhead Load-balanced Scheduling for Sparse Tensor Computations
Muthu Baskaran, Benoit Meister, Richard Lethin
Publication Source: The IEEE Conference on High Performance Extreme Computing (HPEC), Waltham, MA, USA, 2014
Irregular computations over large-scale sparse data are prevalent in critical data applications and they have significant room for improvement on modern computer systems from the aspects of parallelism and data locality. We introduce new techniques to efficiently map large irregular computations onto modern multi-core systems with non-uniform memory access (NUMA) behavior. Our techniques are broadly applicable for irregular computations with multi-dimensional sparse arrays (or sparse tensors).