NVIDIA details session-aware routing for agent workloads in Dynamo

NVIDIA says its Dynamo inference software now links an agent's repeated model requests through a shared session identifier, supporting routing and memory management across an entire task. Claude Code, Codex and OpenCode supply compatible identifiers without configuration; custom agent software can add a request header. A native scheduling plugin tracks sessions and can pause them at tool boundaries under memory pressure. This targets repeated eviction and rebuilding of cached model context when concurrent agents exceed available memory. Session-linked traces also support simulated and live workload replay. The shared cache indexer remains experimental, and an interface for directing cache movement is proposed.