SpCCL: A Sparsity-Aware Collective Communication Library for GPU Platforms
To appearInternational Conference for High Performance Computing, Networking, Storage, and Analysis (SC), 2026
Collective communication is essential to high-performance computing and machine learning workloads, and exploiting sparsity in message payloads can reduce communication overhead.