Tag: brain hemorrhage

Teleradiology AI’s Mixed Bag

Posted on by Brian Casey

An AI algorithm that examined teleradiology studies for signs of intracranial hemorrhage had mixed performance in a new study in Radiology: Artificial Intelligence. AI helped detect ICH cases that might have been missed, but false positives slowed radiologists down. 

AI is being touted as a tool that can detect unseen pathology and speed up the workflow of radiologists facing an environment of limited resources and growing image volume.

  • This dynamic is particularly evident at teleradiology practices, which frequently see high volumes during off-hour shifts; indeed, a recent study found that telerad cases had higher rates of patient death and more malpractice claims than cases read by traditional radiology practices.

So teleradiologists could use a bit more help. In the new study, researchers from the VA’s National Teleradiology Program assessed Avicenna.ai’s CINA v1.0 algorithm for detecting ICH on STAT non-contrast head CT studies.

  • AI was used to analyze 58.3k CT exams processed by the teleradiology service from January 2023 to February 2024, with a 2.7% prevalence of ICH.

Results were as follows…

  • AI flagged 5.7k studies as positive for acute ICH and 52.7k as negative
  • Final radiology reports confirmed that 1.2k exams were true positives for a sensitivity of 76% and a positive predictive value of 21%
  • There were 384 false negatives (missed ICH cases), for a specificity of 92% and a negative predictive value of 99.3%
  • The algorithm’s performance at the VA was a bit lower than in previously published literature
  • Cases that the algorithm falsely flagged as positive took over a minute longer to interpret than prior to AI deployment
  • Overall, case interpretation times were slightly lower after AI than before

One issue to note is that the CINA algorithm is not intended for small hemorrhages with volumes < 3 mL; the researchers did not exclude these cases from their analysis, which could have reduced its performance.

  • Also, at 2.7% the VA’s teleradiology program ICH prevalence was lower than the 10% prevalence Avicenna has used to rate its performance.

The Takeaway

The new findings aren’t exactly a slam dunk for AI in the teleradiology setting, but in terms of real-world results they are exactly what’s needed to assess the true value of the technology compared to outcomes in more tightly controlled environments.

CT Changes Headache Workup

Posted on by Brian Casey

Recent studies have raised concerns about whether CT is overused in the emergency setting for patients with symptoms like headache, but a new study in JAMA Network Open suggests that higher CT utilization could be contributing to a decline in more invasive procedures like lumbar puncture. 

Earlier this month, we covered a study documenting the rapid rise of emergency head CT for patients presenting with acute-onset headache – which could be an indication of subarachnoid hemorrhage or other serious issues. 

  • Researchers theorized that higher CTA utilization could be a sign of overuse because the rate of positive findings over time fell 38%.

But the new study suggests that the growth in cerebral CTA use could have beneficial effects, by reducing the use of more invasive procedures and by detecting unruptured intracranial aneurysm. 

  • Some 5% of acute-onset headaches in emergency patients are caused by subarachnoid hemorrhage; these cases have a 50% risk of death or serious disability at one year, making accurate detection and workup a serious issue.

Researchers from Kaiser Permanente in Northern California analyzed 198k encounters for patients with headache at 21 community EDs from 2015 to 2021. 

  • They compared multiple workup protocols, ranging from CT only to others in which CT was used first, with nondiagnostic cases sent to either lumbar puncture or cerebral CTA. 

Dramatic changes occurred in headache workup over the study period, including … 

  • Overall use of CT grew at an average annual percent change of 5.4%
  • Cerebral CTA use grew 19% annually
  • Lumbar puncture use fell 11% annually
  • Detection of unruptured intracranial aneurysms grew 33%
  • The ratio of unruptured aneurysms to subarachnoid hemorrhage grew

The authors noted that the findings show clinicians are shifting away from a headache workup protocol that includes lumbar puncture to one that relies more on cerebral CTA.

  • The researchers were equivocal on the increase in detection of unruptured aneurysms; on the one hand, the absolute risk of rupture is low, but on the other, the consequences of rupture are severe.  

The Takeaway

The new study offers a more nuanced – and perhaps more positive – view of growing cerebral CTA use in the ED. In the end, it’s possible that two conflicting statements can be true: CT indeed may be overused in the emergency department, but its growing use is also having a beneficial impact on patient care.

Get every issue of The Imaging Wire, delivered right to your inbox.

You might also like..

Select All

You're signed up!

It's great to have you as a reader. Check your inbox for a welcome email.

-- The Imaging Wire team

You're all set!