知镜 Cognispect · 医学文献与研究工作台

AUCp: Pseudo-AUC for Inference Model Selection With Unlabeled Validation Data in Abnormality Detection.

Rahman Siddiquee MM, Rafsani F, Shah J, Wu T, Chong CD, Schwedt TJ, Li B.
IEEE transactions on medical imaging · 2026-07-01 · PMID 42009338

文献摘要

Abnormality detection is a crucial yet challenging task in medical image analysis. Distinguishing abnormalities from normal data by learning to reconstruct normal-only data alleviates the reliance on labeled datasets. However, many studies, even if unsupervised, rely on a labeled validation set to select the best model for inference from multiple training iterations. For many diseases labeled data are unavailable and substantially time consuming to obtain. To address this, ${\textit {AUC}}_{p}$ - a novel metric that supports abnormality detection for unsupervised and self-supervised methods is proposed. Instead of evaluating the realism of reconstructed images to select the best of model for inference, it focuses on actual detection performance and without requiring an annotated test set. Assuming the pseudo ground truth of all unannotated samples in the test set as abnormal/positive and using traditional AUC calculation, ${\textit {AUC}}_{p}$ scores are derived. Given a large and representative training set of normal samples, we show mathematical and empirical evidence that model selection using ${\textit {AUC}}_{p}$ scores improves disease detection in terms of unsupervised and self-supervised methods over conventional metrics. Using two unsupervised methods for neurologic disease detection and self-supervised methods on diverse datasets, our results demonstrate that the ${\textit {AUC}}_{p}$ score effectively identifies the optimal model for inference, significantly enhancing abnormality and disease detection. The corresponding implementations are available in https://github.com/mahfuzmohammad/AUCp.

在知镜精读原文来源DOI 原文

知镜提供医学文献检索、阅读笔记、人体图谱、统计绘图与研究复现工具。