papersTODAY 04:00 UTC
X-Stage Paper Models Post-Issue Backpressure in Fused GPU Communication
A new arXiv paper examines how device-initiated communication affects fused GPU kernels that issue remote stores straight from their compute pipelines, a common pattern in expert and tensor parallelism. The authors introduce X-Stage, a model of post-issue backpressure that arises once such stores have been dispatched. The work aims to characterize performance limits in these communication-computation overlapped workloads.