One of the criticisms of AI in radiology is that there isn’t much data on its effectiveness in real-world environments. Well, a new study in JACR aims to fill that gap by detailing how AI adoption at a large imaging network in Europe affected key radiology performance metrics.
Plenty of studies have been published on AI’s positive contribution to radiologists’ diagnostic performance.
- But in most cases this research was performed under controlled conditions, or involved a single AI algorithm working on a particular task. That’s left many wondering how well AI would perform under actual conditions.
In the new study, researchers tracked the performance of 10 AI algorithms from seven vendors that were implemented over the Incepto Medical AI orchestration platform at 3R Swiss Imaging Network, a 20-center outpatient radiology network in Switzerland.
- Over 4.5 years, researchers tracked the network’s performance before and after AI implementation for the major radiology key performance indicator, report turnaround time (TAT). They also tracked AI adoption rates and infrastructure latency, or how delays in data transfer between PACS networks affected AI usage.
In all, 389k AI-assisted imaging exams were processed over the implementation period from 2021 to 2025, with researchers finding…
- AI’s biggest impact was in high-volume modalities, reducing TAT for trauma radiography (-26%) and knee MRI (-18%).
- AI improved the network’s diagnostic capacity, performing the work of almost half a full-time-equivalent radiologist for trauma radiography alone (0.46 FTE).
- AI usage rates were high, with 91% reporting active AI adoption and 66% reporting regular use.
On the downside, latency in data transfer between PACS networks slowed down AI performance, and in some cases AI results arrived after reports were finalized – too late to make a clinical impact…
- Median total latency was 2.06 minutes per exam, with 72% attributable to data routing and tasks like fetching studies from PACS.
- AI’s “too late rate” was 7.2% overall, ranging from 13% for chest CT to 3% for knee MRI, with 6.8% for trauma X-ray.
How did the network’s radiologists feel about AI? Researchers surveyed over 50 radiologists working for the network, finding that most of the differences in before-and-after opinions weren’t statistically significant.
- The only difference was a modest gain in the perception that AI made radiologists more productive (from 2.57 to 2.94 on a five-point Likert scale).
The Takeaway
The new study fills in a major gap in real-world experience regarding radiology AI implementation. It also reveals areas for improvement, as slow data transfer rates between networks can prevent AI results from reaching radiologists in time.
