Skip to main content
eScholarship
Open Access Publications from the University of California

UCSF

UC San Francisco Previously Published Works bannerUCSF

Stress testing reveals gaps in clinic readiness of image-based diagnostic artificial intelligence models.

  • Author(s): Young, Albert T;
  • Fernandez, Kristen;
  • Pfau, Jacob;
  • Reddy, Rasika;
  • Cao, Nhat Anh;
  • von Franque, Max Y;
  • Johal, Arjun;
  • Wu, Benjamin V;
  • Wu, Rachel R;
  • Chen, Jennifer Y;
  • Fadadu, Raj P;
  • Vasquez, Juan A;
  • Tam, Andrew;
  • Keiser, Michael J;
  • Wei, Maria L
  • et al.
Abstract

Artificial intelligence models match or exceed dermatologists in melanoma image classification. Less is known about their robustness against real-world variations, and clinicians may incorrectly assume that a model with an acceptable area under the receiver operating characteristic curve or related performance metric is ready for clinical use. Here, we systematically assessed the performance of dermatologist-level convolutional neural networks (CNNs) on real-world non-curated images by applying computational "stress tests". Our goal was to create a proxy environment in which to comprehensively test the generalizability of off-the-shelf CNNs developed without training or evaluation protocols specific to individual clinics. We found inconsistent predictions on images captured repeatedly in the same setting or subjected to simple transformations (e.g., rotation). Such transformations resulted in false positive or negative predictions for 6.5-22% of skin lesions across test datasets. Our findings indicate that models meeting conventionally reported metrics need further validation with computational stress tests to assess clinic readiness.

Many UC-authored scholarly publications are freely available on this site because of the UC's open access policies. Let us know how this access is important for you.

Main Content
For improved accessibility of PDF content, download the file to your device.
Current View