On-Device Deep Research at 4B: Exposure Bounds Faithfulness, Retrieval Bounds Coverage
Decoupling faithfulness and retrieval to scale research agents on local hardware.
On-device research agents search a corpus, read sources, and write a cited brief on a personal laptop. Whether their citations are faithful, and at what cost, is unmeasured for a deployable small model. This study fixes one 4B generator on a 24 GB laptop and asks what makes its c...
ArXiv CS.AI
Source
Generated insight by OnAirToday AI
This research provides a critical framework for optimizing small, on-device models by decoupling the mechanics of citation faithfulness from retrieval coverage. It proves that increasing source exposure is a high-efficiency lever for model reliability without needing the massive parameter counts typically associated with reasoning tasks.
Comments
Keep comments relevant and respectful. No links, advertising, self-promotion, or spam.