A system for allocation of one or more data structures used in a program across a number of processing units takes into account a memory access pattern of the data structure, and the amount of total memory available for duplication across the several processing units. Using these parameters duplication factors are determined for the one or more data structures such that the cost of remote communication is minimized when the data structures are duplicated according to the respective duplication factors while allowing parallel execution of the program.
9 Nov 2020
Source: 2020 IEEE/ACM Innovating the Network for Data-Intensive Science (IN...
The Theory of Bottleneck Structures is a recently developed framework for studying the performance of data networks. It describes how…