An AI algorithm that analyzed completed radiology reports found incidental cancers that weren’t being followed up by clinicians. The study, published in Journal of Surgical Research, offers a blueprint for how imaging practices can leverage AI to improve patient care and reduce malpractice risk.
Many of the early radiology AI applications focused on the technology’s ability to assist radiologists by identifying pathology hidden on medical images.
- But AI is also being developed for natural language processing (NLP) tasks – sifting through massive amounts of text to find keywords that could indicate a high-risk incidental finding.
The new study falls into the latter category. Researchers at Banner MD Anderson Cancer Center in Arizona studied the implementation two years ago of Azra AI, software designed to track incidental oncology findings.
- The algorithm identified high-risk lesions in outpatient and emergency reports through NLP analysis, using keywords provided by Banner researchers. It then provided a framework by which patients were navigated through follow-up care without falling through the cracks.
Over 13 months of use, Banner clinicians used Azra AI to review 961.3k radiology reports, finding…
- High-risk lesions were identified in 5% (48.6k) of reports.
- Clinician review confirmed 43.7k clinically significant findings, giving the software a 4.5% finding rate and 0.5% false-positive rate.
- 445 patients were navigated to multidisciplinary care.
- After workup, 67 patients were diagnosed with cancer, representing 0.2% incidence among all validated reports and 15% incidence among navigated patients.
The researchers pointed out that working up this many incidental findings manually would have taken significantly longer, and many patients would have been overlooked entirely.
- That would create significant malpractice risk for imaging providers, especially given a new report indicating that 80% of malpractice claims involve errors in judgment like missing diagnoses (see The Wire section).
Finally, it’s worth noting that the new study gives a boost to Azra AI, which is in the process of taking over AI platform company Blackford.
- Azra AI executives see AI point-source algorithms available on Blackford Platform as key to their goal of offering a comprehensive AI-based framework for both detecting pathology and making sure patients are followed up.
The Takeaway
The new study on AI-based NLP analysis of radiology reports offers a tantalizing vision of how AI can help imaging providers identify patients who might otherwise fall through the cracks and get them the care they need. And there are 67 people who can vouch for that.

