ASN's Mission

To create a world without kidney diseases, the ASN Alliance for Kidney Health elevates care by educating and informing, driving breakthroughs and innovation, and advocating for policies that create transformative changes in kidney medicine throughout the world.

learn more

Contact ASN

1401 H St, NW, Ste 900, Washington, DC 20005

email@asn-online.org

202-640-4660

The Latest on X

Kidney Week

Abstract: SA-PO0047

Evaluating Zero-Shot Claude Vision for Kidney Biopsy Adequacy Assessment

Session Information

Category: Artificial Intelligence, Digital Health, and Data Science

  • 300 Artificial Intelligence, Digital Health, and Data Science

Authors

  • Eigbire-Molen, Odianosen J., Arkana, Little Rock, Arkansas, United States
  • Dercatshoff Pereira Rodrigues, Ricardo, Arkana, Little Rock, Arkansas, United States
  • Cassol, Clarissa Araujo, Arkana, Little Rock, Arkansas, United States
  • Sharma, Shree G., Arkana, Little Rock, Arkansas, United States
Background

Kidney biopsy inadequacy has increased from approximately 2% in 2005 to 14% in 2020, with important consequences for deceased-donor organ utilization. Previous smartphone-based adequacy assessment tools required custom-trained deep learning pipelines, including U-Net segmentation and classification (Eigbire-Molen et al., J Pathol Inform 2024). We hypothesized that Claude Vision (Anthropic), a general-purpose multimodal AI, could achieve comparable performance using zero-shot image classification guided by domain-specific prompting — without model training, GPU infrastructure, or segmentation workflow.

Methods

We evaluated 747 iPhone macro images of deceased-donor kidney biopsy cores. Each image was labeled for percent cortex by at least two nephropathologist based on PAS-stained sections, with adequacy defined as at least 30% renal cortex. Images were divided into a 600-image prompt development set and a 147-image blinded test set.

The prompt development set was used to refine a text prompt describing visual criteria for renal cortex, medulla, and perirenal fat. The blinded test set was enriched for inadequate biopsies (40 inadequate, 107 adequate) to ensure sufficient representation of the clinically higher-stakes error class. Images were classified using Claude Opus-4-7 via the Anthropic API.

Results

On the test set, Claude Vision achieved 86% accuracy, 97% sensitivity for inadequate cores, 85% specificity, and AUC-ROC of 0.91. These results compare favorably with previously reported performance from a task-trained deep learning pipeline which achieved 81% accuracy, 71% sensitivity, 83% specificity, and AUC-ROC of 0.80. The largest improvement was observed in sensitivity for inadequate biopsy cores, the clinically higher-stakes error category, with implications for reducing the rate of missed inadequate cores that may lead to erroneous organ utilization decisions.

Conclusion

Claude Vision exceeded the previously reported performance of a custom-trained deep learning pipeline for assessing deceased-donor renal biopsy adequacy from smartphone macro images. This approach can be deployed through a single API call, offering a low-barrier alternative for laboratories without machine learning expertise. Limitations include evaluation limited to deceased-donor kidneys, AI optimism bias, reduced interpretability compared with task-specific models, and susceptibility to performance changes with future model updates.