papersTODAY 04:00 UTC
arXiv paper proposes keeping LLM-agent routing decisions on GPU to avoid host round trips
A preprint describes a control mechanism for LLM agents that keeps small routing decisions computed on the GPU instead of sending them back to host memory for redispatch. The authors report faster execution than host-based dispatch across 36 tested placements. The work is positioned as a way to bound GPU opportunity and cut per-step communication overhead in agent control loops.