For years, the way large language models handle inference has been stuck inside a box — literally. The high-bandwidth RDMA networks that make modern ...