Tipping Point for Breast AI?

Have we reached a tipping point when it comes to AI for breast screening? This week another study was published – this one in Radiology – demonstrating the value of AI for interpreting screening mammograms. 

Of all the medical imaging exams, breast screening probably could use the most help. Reading mammograms has been compared to looking for a needle in a haystack, with radiologists reviewing thousands of images before finding a single cancer. 

AI could help in multiple ways, either at the radiologist’s side during interpretation or by reviewing mammograms in advance, triaging the ones most likely to be normal while reserving suspicious exams for closer attention by radiologists (indeed, that was the approach used in the MASAI study in Sweden in August).

In the new study, UK researchers in the PERFORMS trial compared the performance of Lunit’s INSIGHT MMG AI algorithm to that of 552 radiologists in 240 test mammogram cases, finding that …

  • AI was comparable to radiologists for sensitivity (91% vs. 90%, P=0.26) and specificity (77% vs. 76%, P=0.85). 
  • There was no statistically significant difference in AUC (0.93 vs. 0.88, P=0.15)
  • AI and radiologists were comparable or no different with other metrics

Like the MASAI trial, the PERFORMS results show that AI could play an important role in breast screening. To that end, a new paper in European Journal of Radiology proposes a roadmap for implementing mammography AI as part of single-reader breast screening programs, offering suggestions on prospective clinical trials that should take place to prove breast AI is ready for widespread use in the NHS – and beyond. 

The Takeaway

It certainly does seem that AI for breast screening has reached a tipping point. Taken together, PERFORMS and MASAI show that mammography AI works well enough that “the days of double reading are numbered,” at least where it is practiced in Europe, as noted in an editorial by Liane Philpotts, MD

While double-reading isn’t practiced in the US, the PERFORMS protocol could be used to supplement non-specialized radiologists who don’t see that many mammograms, Philpotts notes. Either way, AI looks poised to make a major impact in breast screening on both sides of the Atlantic.

Screening Foes Strike Back

Opponents of population-based cancer screening aren’t going away anytime soon. Just weeks after publication of a landmark study claiming that cancer screening has saved $7T over 25 years, screening foes published a counterattack in JAMA Internal Medicine casting doubt on whether screening has any value at all. 

Population-based cancer screening has been controversial since the first programs were launched decades ago. 

  • A vocal minority of skeptics continues to raise concerns about screening, despite the fact that mortality rates have dropped and survival rates have increased for the four cancers targeted by population screening.

This week’s JAMA Internal Medicine featured a series of articles that cast doubt on screening. In the main study, researchers performed a meta-analysis of 18 randomized clinical trials (RCTs) covering 2.1M people for six major screening tests, including mammography, CT lung cancer screening, and colon and PSA tests. 

  • The authors, led by Norwegian gastroenterologist Michael Bretthauer, MD, PhD, concluded that only flexible sigmoidoscopy for colon cancer produced a gain in lifetimes. They conclude that RCTs to date haven’t included enough patients who were followed over enough years to show screening has an effect on all-cause mortality.

But a deeper dive into the study produces interesting revelations. For CT lung cancer screening, Bretthauer et al didn’t include the landmark National Lung Screening Trial, an RCT that showed a 20% mortality reduction from screening.

  • With respect to breast imaging, the researchers only included three studies, even though there have been eight major mammography RCTs performed. And one of the three included was the controversial Canadian National Breast Screening Study, originally conducted in the 1980s.

When it comes to colon screening, Bretthauer included his own controversial 2022 NordICC study in his meta-analysis. 

  • The NordICC study found that if a person is invited to colon screening but doesn’t follow through, they don’t experience a mortality benefit. But those who actually got colon screening saw a 50% mortality reduction.  

Other articles in this week’s JAMA Internal Medicine series were penned by researchers well known for their opposition to population-based screening, including Gilbert Welch, MD, and Rita Redberg, MD.

The Takeaway

There’s an old saying in statistics: “If you torture the data long enough, it will confess to anything.” Among major academic journals, JAMA Internal Medicine – which Redberg guided for 14 years as editor until she stepped down in June – has consistently been the most hostile toward screening and new medical technology.

In the end, the arguments being made by screening’s foes would carry more weight if they were coming from researchers and journals that haven’t already demonstrated a longstanding, ingrained bias against population-based cancer screening.

Value of Cancer Screening

A new study claims that medical screening for diseases like breast and cervical cancer has saved lives and generated value of at least $7.5T (yes, trillion) over the last 25 years. The findings, published in BMC Health Services Research, are a stunning rebuke to critics of screening exams.

While the vast majority of doctors and public health officials support evidence-based screening, a vocal minority of skeptics continues to raise questions about screening’s efficacy. These critics emphasize the “harms” of screening, such as overdiagnosis and patient anxiety – an accusation often levied against breast screening. 

Screening’s critics also target the downstream costs of medical tests intended to confirm suspicious findings. They argue that a single screen-detected finding can lead to a cascade of additional healthcare spending that drives up medical costs.

But the new study offers a counter-argument, putting a dollar figure on how much screening exams have saved by detecting disease earlier, when it can be treated more effectively. 

The research focused on the four main cancer screening tests – breast, cervical, colon, and lung cancer – analyzing the impact of preventive screening on life-years saved and its economic impact from 1996 to 2020, finding …

  • Americans enjoyed at least 12M more years of life thanks to cancer screening
  • The economic value of these life-years added up to at least $7.5T
  • If everyone who qualified for screening exams got them, it would save at least another 3.3M life-years and $1.7T in economic impact
  • Cervical cancer screening had by far the biggest economic impact ($5.2T-$5.7T), followed by breast ($0.8T-$1.9T), colorectal ($0.4T-$1T), and finally lung ($40B). 

Lung cancer’s paltry value was due to a small eligible population and low screening adherence rates. This finding is underscored by a new article in STAT that ponders why CT lung cancer screening rates are so low, with one observer calling it the “redheaded stepchild” of screening tests.  

The Takeaway
Screening skeptics have been taking it on the chin lately (witness the USPSTF’s U-turn on mammography for younger women) and the new findings will be another blow. We may continue to see a dribble of papers on the “harms” of overdiagnosis, but the momentum is definitely shifting in screening’s favor – to the benefit of patients.

Taking Ultrasound Beyond Breast Density

When should breast ultrasound be used as part of mammography screening? It’s often used in cases of dense breast tissue, but other factors should also come into play, say researchers in a new study in Cancer

Conventional X-ray mammography has difficulties when used for screening women with dense breast tissue, so supplemental modalities like ultrasound and MRI are called into play. But focusing too much on breast density alone could mean that many women who are at high risk of breast cancer don’t get the additional imaging they need.

To study this issue, researchers analyzed the risk of mammography screening failures (defined as interval invasive cancer or advanced cancer) in ~825k screening mammograms in ~377k women, and more than ~38k screening ultrasound studies in ~29k women. All exams were acquired from 2014 to 2020 at 32 healthcare facilities across the US.

Researchers then compared the mammography failure rate in women who got ultrasound and mammography to those who got mammography alone. Their findings included: 

  • Ultrasound was appropriately targeted at women with heterogeneously or extremely dense breasts, with 95.3% getting scans
  • However, based on their complete risk factor profile, women with dense breasts who got ultrasound had only a modestly higher risk of interval breast cancer compared to women who only got mammography (23.7% vs. 18.5%) 
  • More than half of women undergoing ultrasound screening had low or average risk of an interval breast cancer based on their risk factor profile, despite having dense breasts
  • The risk of advanced cancer was very close between the two groups (32.0% vs. 30.5%), suggesting that a large fraction of women at risk of advanced cancer are getting only mammography screening with no supplemental imaging

The Takeaway 

On the positive side, ultrasound is being widely used in women with dense breast tissue, indicating success in identifying these women and getting them the supplemental imaging they need. But the high rate of advanced cancer in women who only received mammography indicates that consideration of other risk factors – such as family history of breast cancer and body mass index – is necessary beyond just breast tissue density to identify women in need of supplemental imaging. 

Breast Screening’s New Gold Standard?

A new study in Radiology on the use of digital breast tomosynthesis for breast screening makes the case that DBT has so many advantages over conventional 2D digital mammography that it should be considered the gold standard for breast screening. 

Unlike 2D mammography, DBT systems scan around the breast in an arc, acquiring multiple breast images that are combined into 3D volumes. The technique is believed to be more effective in revealing pathology that might be obscured on 2D projections.

Previous research already demonstrated the effectiveness of DBT for certain uses, but the new study is notable for its large patient population, as well as its focus on general screening rather than subgroups like women with cancer risk factors such as dense breast tissue.

Researchers led by Dr. Emily Conant of the University of Pennsylvania reviewed DBT’s performance in five large U.S. healthcare systems, with a total study population of over 1 million women. 

The advantages of DBT were notable:

  • Higher cancer detection rate: 5.5 vs. 4.5 per 1k women screened
  • Lower recall rate:  8.9% vs. 10.3%
  • Higher recall PPV: 5.9% vs. 4.3%.

On the negative side, DBT had higher biopsy rates, of 17.6 biopsies per 1,000 women versus 14.5 biopsies for 2D digital mammography. But PPV of biopsy for both techniques was largely the same. 

Researchers note that breast cancer mortality rates have fallen 41% since 1989, a development attributed to earlier diagnosis and better treatment. DBT could help accelerate this trend as it finds more cancers relative to 2D digital mammography.

The Takeaway

This study reinforces the idea that DBT is now the gold standard for breast screening. While mammography vendors have already seen high market penetration for DBT systems, the new study is likely to convince any remaining holdouts that 3D mammography is a necessary technology for any breast imaging facility. 

Get every issue of The Imaging Wire, delivered right to your inbox.

You might also like..

Select All

You're signed up!

It's great to have you as a reader. Check your inbox for a welcome email.

-- The Imaging Wire team

You're all set!