ResearchAug 17, 2026
A Year in LLM Serving: Workload Evolution, Caching and Load-Balancing
An arXiv research paper analyzes a year of LLM serving workloads, examining workload evolution, caching, and load-balancing in production environments.
#LLM serving#workload analysis#caching#load-balancing#research#LLM