Category: Artificial Intelligence

Report from ECR 2024

Posted on by Brian Casey

ECR 2024 kicked off yesterday in Vienna, Austria, with European radiology professionals gathering to celebrate the field and demonstrate the latest in medical imaging research and technology. 

As we noted in last year’s coverage, ECR has bounced back strongly from the disruptions of the COVID-19 pandemic. 

  • While this year’s attendance numbers aren’t in yet, the rooms and halls of Austria Center Vienna appear to be just as crowded as in the pre-pandemic days.

In particular, the show’s opening ceremony on Wednesday evening was standing room only, with attendees delighting in friendly banter on the future of AI and radiology between congress president Carlo Catalano, MD, and Ameca, an AI-powered animatronic robot. 

From a content perspective, this year’s meeting continues a strong focus on AI.

Some highpoints from the first few days are as follows:

The Takeaway
Based on the first two days, ECR 2024 is off to a great start. We’ll be featuring additional coverage in upcoming issues, so be sure to come back, and check out our YouTube channel and LinkedIn page for video highlights from the conference.

Real-World AI Experiences

Posted on by Brian Casey

Clinical studies showing that AI helps radiologists interpret medical images are great, but how well does AI work in the real world – and what do radiologists think about it? These questions are addressed in a new study in Applied Ergonomics that takes a deep dive into the real-world implementation of a commercially available AI algorithm at a German hospital. 

A slew of clinical studies supporting AI were published in 2023, from the MASAI study on AI for breast screening to smaller studies on applications like opportunistic screening or predicting who should get lung cancer screening. 

  • But even an AI algorithm with the best clinical evidence behind it could fall flat if it’s difficult to use and doesn’t integrate well with existing radiology workflow.

To gain insight into this issue, the new study tracked University Hospital Bonn’s implementation of Quantib’s Prostate software for interpreting and documenting prostate MRI scans (Quantib was acquired by RadNet in January 2022). 

  • Researchers described the solution as providing partial automation of prostate MRI workflow, such as helping segment the prostate, generating heat maps of areas of interest, and automatically producing patient reports based on lesions it identifies. 

Prostate was installed at the hospital in the spring of 2022, with nine radiology residents and three attending physicians interviewed before and after implementation, finding…

  • All but one radiologist had a positive attitude toward AI before implementation and one was undecided 
  • After implementation, seven said their attitudes were unchanged, one was disappointed, and one saw their opinion shift positively
  • Use of the AI was inconsistent, with radiologists adopting different workflows and some using it all the time with others only using it occasionally
  • Major concerns cited included workflow delays due to AI use, additional steps required such as sending images to a server, and unstable performance

The findings prompted the researchers to conclude that AI is likely to be implemented and used in the real world differently than in clinical trials. Radiologists should be included in AI algorithm development to provide insights into workflow where the tools will be used.

The Takeaway

The new study is unique in that – rather than focusing on AI algorithm performance – it concentrated on the experiences of radiologists using the software and how they changed following implementation. Such studies can be illuminating as AI developers seek broader clinical use of their tools. 

AI Models Go Head-to-Head in Project AIR Study

Posted on by Brian Casey

One of the biggest challenges in assessing the performance of different AI algorithms is the varying conditions under which AI research studies are conducted. A new study from the Netherlands published this week in Radiology aims to correct that by testing a variety of AI algorithms head-to-head under similar conditions. 

There are over 200 AI algorithms on the European market (and even more in the US), many of which address the same clinical condition. 

  • Therefore, hospitals looking to acquire AI can find it difficult to assess the diagnostic performance of different models. 

The Project AIR initiative was launched to fill the gap in accurate assessment of AI algorithms by creating a Consumer Reports-style testing environment that’s consistent and transparent.

  • Project AIR researchers have assembled a validated database of medical images for different clinical applications, against which multiple AI algorithms can be tested; to ensure generalizability, images have come from different institutions and were acquired on equipment from different vendors. 

In the first test of the Project AIR concept, a team led by Kicky van Leeuwen of Radboud University Medical Centre in the Netherlands invited AI developers to participate, with nine products from eight vendors validated from June 2022 to January 2023: two models for bone age prediction and seven algorithms for lung nodule assessment (one vendor participated in both tests). Results included:

  • For bone age analysis, both of the tested algorithms (Visiana and Vuno) showed “excellent correlation” with the reference standard, with an r correlation coefficient of 0.987-0.989 (1 = perfect agreement)
  • For lung nodule analysis, there was a wider spread in AUC between the algorithms and human readers, with humans posting a mean AUC of 0.81
  • Researchers found superior performance for Annalise.ai (0.90), Lunit (0.93), Milvue (0.86), and Oxipit (0.88)

What’s next on Project AIR’s testing agenda? Van Leeuwen told The Imaging Wire that the next study will involve fracture detection. Meanwhile, interested parties can follow along on leaderboards for both bone age and lung nodule use cases. 

The Takeaway

Head-to-head studies like the one conducted by Project AIR may make many AI developers squirm (several that were invited declined to participate), but they are a necessary step toward building clinician confidence in the performance of AI algorithms that needs to take place to support the widespread adoption of AI. 

Lunit’s Deal for Volpara and AI Consolidation

Posted on by Brian Casey

Is the long-awaited consolidation of the healthcare AI sector gaining steam? In a deal valued at close to $200M, South Korean AI developer Lunit announced a bid to acquire Volpara Health, a developer of software for calculating breast density and cancer risk. 

At first glance, the alliance seems to be a match made in heaven. Lunit is a well-regarded AI developer that has seen impressive results in clinical trials of its Insight family of algorithms for indications ranging from mammography to chest imaging. 

  • Most recently, Lunit received FDA clearance for its Insight DBT software, marking its entry into the US breast screening market, and it also raised $150M in a public stock offering. 

Volpara has a long pedigree as a developer of breast imaging software, although it has shied away from image analysis applications to instead focus on breast center operations and risk assessment, in particular by calculating breast density. 

  • Thus, combining Lunit’s concentration in image analysis with Volpara’s focus on operations and risk assessment enables the combined company to offer a wider breadth of products to breast centers.

Lunit will also be able to take advantage of the marketing and sales structure that Volpara has built in the US mammography sector (97% of Volpara’s sales come from the US, where it has an installed base of 2k sites). Volpara expects 2024 sales of $30M and is cash-flow positive.

The question is whether the acquisition is a sign of things to come in the AI market. 

  • As commercial AI sales have been slow to develop, AI firms have largely funded their operations through venture capital firms – which are notoriously impatient in their quest for returns.

In fact, observers at the recent RSNA 2023 meeting noted that there were very few new start-up entrants into the AI space, and many AI vendors had smaller booths. 

  • And previous research has documented a slowdown in VC funding for AI developers that is prompting start-up firms to seek partners to provide more comprehensive offerings while also focusing on developing a road to profitability. 

The Takeaway

It’s not clear yet whether the Lunit/Volpara deal is a one-off combination or the start of a renewed consolidation trend in healthcare AI. Regardless of what happens, this alliance unites two of the stronger players in the field and has exciting potential for the years to come. 

AI Powers Opportunistic Screening

Posted on by Brian Casey

The growing power of AI is opening up new possibilities for opportunistic screening – the detection of pathology using data acquired for other clinical indications. The potential of CT-based opportunistic screening – and AI’s role in its growth – was explored in a session at RSNA 2023.

What’s so interesting about opportunistic screening with CT? 

  • As one of imaging’s most widely used modalities, CT scans are already being acquired for many clinical indications, collecting body composition data on muscle, fat, and bone that can be biomarkers for hidden pathology. 

What’s more, AI-based tools are replacing many of the onerous manual measurement tasks that previously required radiologist involvement. There are four primary biomarkers for opportunistic screening, which are typically related to several major pathologies, said Perry Pickhardt, MD, of the University of Wisconsin-Madison, who led off the RSNA session:

  • Skeletal muscle density (sarcopenia)
  • Hard calcified plaque, either coronary or aortic (cardiovascular risk)
  • Visceral fat (cardiovascular risk)
  • Bone mineral density (osteoporosis and fractures) 

But what about the economics of opportunistic screening? 

  • A recent study in Abdominal Radiology found that in a hypothetical cohort of 55-year-old men and women, AI-assisted opportunistic screening for cardiovascular disease, osteoporosis, and sarcopenia was more cost-effective compared to both “no-treatment” and “statins for all” strategies – even assuming a $250/scan charge for use of AI.

But there are barriers to opportunistic screening, despite its potential. In a follow-up talk, Arun Krishnaraj, MD, of UVA Health in Virginia said he believes fully automated AI algorithms are needed to avoid putting the burden on radiologists. 

And the regulatory environment for AI tools is complex and must be navigated, said Bernardo Bizzo, MD, PhD, of Mass General Brigham.

Ready to take the plunge? The steps for setting up a screening program using AI were described in another talk by John Garrett, PhD, Pickhardt’s colleague at UW-Madison. This includes: 

  • Normalizing your data for AI tools
  • Identifying the anatomical landmarks you want to focus on
  • Automatically segmenting areas of interest
  • Making the biomarker measurements
  • Plugging your data into AI models to predict outcomes and risk-stratify patients

The Takeaway

Opportunistic screening has the potential to flip the script in the debate over radiology utilization, making imaging exams more cost-effective while detecting additional pathology and paving the way to more personalized medicine. With AI’s help, radiologists have the opportunity to place themselves at the center of modern healthcare. 

AI’s Impact on Breast Screening

Posted on by Brian Casey

One of the most exciting radiology use cases for AI is in breast screening. At last week’s RSNA 2023 show, a paper highlighted the technology’s potential for helping breast imagers focus on cases more likely to have cancer.

Looking for cancers on screening mammography has been compared to finding a needle in a haystack, and as such it’s considered to be one of the areas where AI can best help. 

  • One of the earliest use cases was in identifying suspicious breast lesions during radiologist interpretation (remember computer-aided detection?), but more recently researchers have focused on using AI as a triage tool, by identifying cases most likely to be normal that could be removed from the radiologist’s urgent worklist. Studies have found that 30-40% of breast screening cases could be read by AI alone or triaged to a low-suspicion list.

But what impact would AI-based breast screening triage have on radiologist metrics such as recall rate? 

  • To answer this question, researchers from NYU Langone Health prospectively tested their homegrown AI algorithm for analyzing DBT screening cases.

The algorithm was trained to identify extremely low-risk cases that could be triaged from the worklist while more complex cases where the AI was uncertain were sent to radiologists, who knew in advance the cases they were reading were more complicated. In 11.7k screening mammograms, researchers examined recall rates over two periods, one before AI triage and one after, finding: 

  • The overall recall rate went from 13% before the triage period to 15% after 
  • Recall rates for complex cases went from 17% to 20%
  • Recall rates for extremely low-risk studies went from 6% to 5%
  • There were no statistically significant differences in any of the comparisons
  • No change in median self-reported perceived difficulty of reading from the triage lists compared to non-triage list, regardless of years of experience

In future work, the NYU Langone researchers will continue their study to look at AI’s impact on cancer detection rate, biopsy rate, positive predictive value, and other metrics.

The Takeaway

The NYU Langone study puts a US spin on research like MASAI from Sweden, in which AI was able to reduce radiologists’ breast screening workload by 44%. Given the differences in screening protocols between the US and Europe, it’s important to assess how AI affects workload between the regions.

Further work is needed in this ongoing study, but early results indicate that AI can triage complex cases without having an undue impact on recall rate or self-perceived difficulty in interpreting exams – a surrogate measure for burnout.

AI’s Incremental Revolution

Posted on by Brian Casey

So AI dominated the discussion at last week’s RSNA 2023 meeting. But does that mean it’s finally on the path to widespread clinical use? 

Maybe not so much. For a technology that’s supposed to have a revolutionary impact on medicine, AI is taking a frustratingly long time to arrive. 

Indeed, there was plenty of skepticism about AI in the halls of McCormick Place last week. (For two interesting looks at AI at RSNA 2023, also see Hugh Harvey, MD’s list of takeaways in a post on X/Twitter and Herman Oosterwijk’s post on LinkedIn.) 

But as one executive we talked to pointed out, AI’s advance to routine clinical use in radiology is likely to be more incremental than all at once. 

  • And from that perspective, last week’s RSNA meeting was undoubtedly positive for AI. Scientific sessions were full of talks on practical clinical applications of AI, from breast AI to CT lung screening. 

Researchers also discussed the use of AI apart from image interpretation, with generative AI and large language models taking on tasks from answering patient questions about their reports to helping radiologists with dictation.

It’s fine to be a skeptic (especially when it comes to things you hear at RSNA), but for perspective look at many of the past arguments casting doubt on AI: 

  • AI algorithms don’t have FDA clearance (the FDA authorized 171 algorithms in just the past year)
  • You can’t get paid for using AI clinically (16 algorithms have CPT codes, with more on the way) 
  • There isn’t enough clinical evidence backing the use of AI (tell that to the authors of MASAI, PERFORMS, and a number of other recent studies with positive findings)
  • The AI market is overcrowded with companies and ripe for consolidation (what exciting new growth market isn’t?)

The Takeaway

Sure, it’s taking longer than expected for AI to take hold in radiology. But last week’s conference showed that AI’s incremental revolution is not only advancing but expanding in ways no one expected when IBM Watson was unveiled to an RSNA audience a mere 6-7 years ago. One can only imagine what the field will look like at RSNA 2030.

Looking for more coverage of RSNA 2023? Be sure to check out our videos from the technical exhibit floor, which you can find on our new Shows page.

AI Dominates at RSNA 2023

Posted on by Brian Casey

Take a deep breath. You survived another RSNA conference.

While a few hardy souls are still enjoying educational sessions in the cozy confines of McCormick Place, the final day of the exhibit floor yesterday marks the end of RSNA 2023 for most attendees. And what a show it was. 

Predictions were that AI would dominate the scientific sessions at RSNA 2023, a forecast that largely panned out. A November 28 session was a case in point, in which a series of top-quality papers were presented on one of the most promising use cases of AI, for breast screening:

  • A homegrown AI algorithm that analyzed screening breast ultrasound exams in addition to FFDM and DBT mammograms boosted sensitivity for detecting cancer in 12.5k patients, with better sensitivity for women with dense breasts (71% vs. 60%) and non-dense breasts (79% vs. 63%)
  • AI did a good job of detecting breast arterial calcification (BAC) when used prospectively to analyze screening mammograms in 16k women across 15 sites.  It found 15% of women had BAC, a possible marker for atherosclerotic disease
  • Swedish researchers used their VAI-B validation platform to compare three AI algorithms (Therapixel, Lunit, and Vara) in 34k women, finding that using AI with a single radiologist boosted sensitivity 10-30% compared to double reading, with a slight loss in specificity (2-7%). VAI-B could be used to validate AI implementation and guide purchasing decisions
  • Why does AI miss some breast cancers? South Korean researchers addressed this question by analyzing 1.1k patients with invasive cancers in which AI had a miss rate of 14%. Luminal cancers were missed most often
  • Adding AI analysis of prior images to current studies with FFDM and DBT boosted sensitivity for cancer detection in 30k patients, with sensitivity the highest for two years of priors compared to no priors (74% vs. 70%)

The Takeaway

This week’s research points to an exciting near-term future in which AI will help make mammography screening more accurate while helping breast radiologists perform their jobs more efficiently. Landmark studies toward this end were published in 2023 – this week’s RSNA conference shows that we can expect the momentum to continue in 2024. 

Reimbursement Drives AI Adoption

Posted on by Brian Casey

It’s no secret that insurance reimbursement drives adoption of new medical technology. But a new analysis in NEJM AI shows exactly how reimbursement is affecting the diffusion into clinical practice of perhaps the newest medical technology – artificial intelligence. 

Researchers analyzed a database of over 11B CPT claims from January 2018 to June 2023 to find out how often reimbursement claims are being submitted for the use of the over 500 AI devices that had been approved by the FDA at the time the paper was finalized. 

  • The authors chose to focus on CPT claims rather than claims under the NTAP program for new technologies because CPT codes are used by both public and private payors in inpatient and outpatient settings, while NTAP only applies to Medicare inpatient payments. 

They found 16 medical AI procedures billable under CPT codes; of these, 15 codes were created since 2021 and the median age of a CPT code was about 374 days, indicating the novelty of medical AI.

  • Also, only four of the 16 had more than 1k claims submitted, leading the authors to state “overall utilization of medical AI products is still limited and focused on a few leading procedures,” such as coronary artery disease and diabetic retinopathy.

The top 10 AI products and number of CPT claims submitted are as follows:

  1. HeartFlow Analysis for coronary artery disease (67,306)
  2. LumineticsCore for diabetic retinopathy (15,097)
  3. Cleerly for coronary atherosclerosis (4,459)
  4. Perspectum LiverMultiScan for liver MRI (2,428)
  5. Perspectum CoverScan for multiorgan MRI (591)
  6. Koios DS for breast ultrasound (552)
  7. Anumana for ECG cardiac dysfunction (435)
  8. CADScor for cardiac acoustic waveform recording (331)
  9. Perspectum MRCP for quantitative MR cholangiopancreatography (237)
  10. CompuFlo for epidural infusion (67)

While radiology may rule in terms of the sheer number of FDA-approved AI products (79% in a recent analysis), the list shows that cardiology is king when it comes to paying the bills. 

The Takeaway

Amid the breathless hype around medical AI, the NEJM AI study comes as a bit of a wake-up call, showing how the cold reality of healthcare economics can limit technology diffusion – a finding also indicated in other studies of economic barriers to AI. 

On the positive side, it shows that a rosy future lies ahead for those AI algorithms – like HeartFlow Analysis – that can make the leap.

Accessing Quality Data for AI Training

Posted on by Partner Content

One of the biggest roadblocks in medical AI development is the lack of high-quality, diverse data for these technologies to train on.

What Is the Issue with Data Access?

Artificial Intelligence (AI) has emerged as a game-changer in the realm of medical imaging, with immense potential to revolutionize clinical practices. AI-powered medical imaging can efficiently identify intricate patterns within data and provide quantitative assessments of disease biomarkers. This technology not only enhances the accuracy of diagnosis but can also significantly speed up the diagnostic process, ultimately improving patient outcomes.

While the landscape is promising, medical innovators grapple with challenges in accessing high-quality, diverse, and timely data, which is vital for training AI and driving progress.

A 2019 study from the Massachusetts Institute of Technology found that over half of medical AI studies predominantly relied on databases from high-income countries, particularly the United States and China. If models trained on homogenous data are used clinically in diverse populations, then it could pose a risk to patients and worsen health inequalities experienced by underrepresented groups. In the United States, If the Food and Drug Administration deems these risks to be too high, then they could even reject a product’s application for approval. 

In trying to get hold of the best training data, AI developers, particularly startups and individual researchers, face a web of complexities, including legal, ethical, and technical considerations. Issues like data privacy, security, interoperability, and data quality compound these challenges, all of which are crucial in the effective and responsible utilization of healthcare data.

One company working to overcome these hurdles in hope of accelerated and high-quality innovations is Gradient Health.

Gradient Health’s Approach

Gradient Health offers AI developers instant access to one of the world’s largest libraries of anonymized medical images, sourced from hundreds of global hospitals, clinics, and research centers. This data is meticulously de-identified for compliance and can be tailored by vendors to suit their project’s needs and exported in machine learning-ready DICOM + JSON formats.

By partnering with Gradient Health, innovators can use these extensive, diverse datasets to train and validate their AI algorithms, mitigating bias in medical AI and advancing the development of precise, high-quality medical solutions.

Gaining access to top-tier data at the outset of the development process promises long-term benefits. Here’s how:

  • Expand Market Presence: Access the latest cross-vendor datasets to develop medical innovations, expanding your market share.
  • Global Expansion: Enter new regions swiftly with locally sourced data from your target markets, accelerating your global reach.
  • Competitive Edge: Obtain on-demand training data for imaging modalities and disease areas, facilitating product portfolio expansion.
  • Speed to Market: Quickly acquire data for product training and validation, reducing sourcing time and expediting regulatory clearances for faster patient delivery.

“After looking for a data provider for many weeks, I was not able to get even a sample delivery within one month. I was immensely glad to work with Gradient and go from first contact to final delivery within one week!” said Julien Schmidt, chief operations officer and co-founder at Mango Medical.

The Outlook

In recent years, medical AI has experienced significant growth. Innovations in medical imaging in particular have played a pivotal role in enabling healthcare professionals to identify diseases earlier and more accurately in patients with a range of conditions. 

Gradient Health offers a data-compliant, intuitive platform for AI developers, facilitating access to the essential data required to train these critical technologies. This approach holds the potential to save time, resources, and, most importantly, lives. 

More information about Gradient Health is available on the company’s website. They will also be exhibiting at RSNA 2023 in booth #5149 in the South Hall.

Get every issue of The Imaging Wire, delivered right to your inbox.

You might also like..

Select All

You're signed up!

It's great to have you as a reader. Check your inbox for a welcome email.

-- The Imaging Wire team

You're all set!