23
Ensemble Routing for Prompt-Adaptive Cost-Aware LLM Inference
arXiv:2611.10193v1 Announce Type: new Abstract: Large language models (LLMs) increasingly support Web-based services that must balance response quality and inference cost across heterogeneous requests. Conventional routing selects one model per prompt, while fixed ensembles cann…
🅲 hạng C