VibeServe: Can AI Agents Build Bespoke LLM Serving Systems?
arXiv:2605.06068v2 Announce Type: replace Abstract: For years, we have built LLM serving systems like any other critical infrastructure, with a single general-purpose stack hand-tuned over many engineer-years to support every model and workload. In this paper, we take the opposite bet and let coding