Our paper “The Case for Strong Scaling in Deep Learning: Training Large 3D CNNs with Hybrid Parallelism” has been accepted for the Special Section on Parallel and Distributed Computing Techniques for AI, ML, and DL in IEEE Transactions on Parallel and Distributed Systems (TPDS).
The early access version of our paper is available on IEEE Xplore.
The preprint version is available on arXiv.