A Feasibility Condition for Confidence-Gated Tiered LLM Inference

Tiered inference distributes large language model computation across a hierarchy of devices, from on-device and edge hardware to the datacenter, and is increasingly offered as the route to cheaper, lower-latency, and more private serving.

ArXiv CS.AI2026-11-05