AI Research

    Diagnostic Accuracy and Navigation Behavior of Vision-Language Model Agents Reading Emergency CT and MRI Examinations

    The research examines the diagnostic accuracy and navigation behavior of vision-language model agents reading emergency CT and MRI examinations.

    AC

    ArXiv CS.AI

    Source

    ArXiv CS.AI

    Purpose. To evaluate the diagnostic accuracy and image navigation behavior of vision-language model (VLM) agents under varying exploration strategies. Materials and Methods. In this retrospective study, six VLMs read 100 emergency CT and MRI examinations published in a public archive (March 2025-August 2026) under four conditions (free navigation, navigation from a key slice, and all slices or key slices in a single request), twice each (4800 runs). Nine radiologists read 30 of those cases. A large language model judge validated against two radiologists graded the answers. Conditions were compared with generalized estimating equations clustered by case. Results. Pooled accuracy was lowest under free navigation (32.6%; 391/1200), followed by navigation from a key slice (37.9%; 455/1200; P = .003), and highest with all slices (42.2%; 506/1200) or key slices (42.5%; 510/1200) in one request (both P

    AI Analysis

    Generated insight by OnAirToday AI

    Evaluating both diagnostic accuracy and navigation behavior can reveal how vision-language agents approach emergency imaging, not just what answers they produce. The topic matters because emergency CT and MRI interpretation is a high-stakes setting for assessing these systems.

    Powered by AI • Not a substitute for human analysisMore Insights →
    Read the full story at ArXiv CS.AI →
    Share
    Filed under:AI Research

    Comments

    Keep comments relevant and respectful. No links, advertising, self-promotion, or spam.

    0/1000