AI Research
Cost-Governed RAG: Unified Per-Tenant Cost Attribution Across Retrieval and Generation in Multi-Tenant LLM Systems
Bridging the observability gap in multi-tenant RAG systems through deterministic retrieval cost attribution.
Enterprise Retrieval-Augmented Generation (RAG) deployments face a critical governance gap: while LLM generation cost is metered per token, the retrieval layer - vector memory, similarity compute, and embedding API calls - remains an unattributed shared cost, enabling invisible c...
AC
ArXiv CS.AI
Source
2 min
ArXiv CS.AIRead the full story at ArXiv CS.AI
AI Analysis
Generated insight by OnAirToday AI
Cost-Governed RAG provides the granular observability required for businesses to accurately bill tenants for the full lifecycle of an AI query. By decoupling vector infrastructure costs from shared pools, this architecture finally makes multi-tenant LLM deployments financially sustainable and transparent.
Powered by AI • Not a substitute for human analysisMore Insights →
Share
Filed under:AI Research
Comments
Keep comments relevant and respectful. No links, advertising, self-promotion, or spam.