Loading your page…
medRxiv
By Hamda, H. K. H., Mustafa, S. and Khalili Moghaddam, G..
Self-supervised learning may improve segmentation when labelled data are limited, but its benefit may depend on model and initialisation strategy. This study evaluated in-domain masked-reconstruction pretraining across limited annotation budgets.
Ward brings these articles into the same app as your cards and questions. One free account for Ward, Suture, Osler and Prognia.
The International Skin Imaging Collaboration (ISIC) 2016 development set was partitioned into 765 images for self-supervised pretraining, 94 for fine-tuning and 41 for validation. Five nested annotation budgets (12-94 images) and five seeds were evaluated on the 379-image test set. A custom U-Net compared random and in-domain self-supervised initialisation; a ResNet-34 U-Net compared random, ImageNet, in-domain self-supervised and sequential ImageNet-to-self-supervised initialisation. Models trained with 94 labelled images were evaluated without adaptation on ISIC 2017. A separate experiment examined restoration-based pretraining.
In the custom U-Net, self-supervised pretraining achieved higher mean Dice than random initialisation at all five budgets, including 0.664 versus 0.615 with 12 labels and 0.811 versus 0.768 with 94 labels. Seed-level 95% confidence intervals for paired differences excluded zero at 47 and 94 labels but not at the other budgets. With 47 labels, the self-supervised model achieved mean Dice of 0.789, compared with 0.768 for random initialisation with 94 labels. In ResNet-34, ImageNet initialisation achieved higher mean Dice than in-domain self-supervised pretraining at all five budgets, and adding self-supervised pretraining after ImageNet reduced mean Dice at four of five budgets. All six 94-label configurations achieved lower mean Dice on ISIC 2017 than ISIC 2016. In the restoration experiment, mean Dice was 0.686 with random initialisation and 0.638-0.642 following pretraining.
In-domain masked-reconstruction pretraining improved mean Dice relative to random initialisation in the custom U-Net, but not consistently in the ResNet-34 U-Net, where ImageNet initialisation performed better at every budget. Adding self-supervised pretraining after ImageNet provided no consistent gain. These findings are specific to the dermoscopic lesion-segmentation experiments and do not establish melanoma-specific diagnostic or clinical performance.
This is a preprint: it has not been peer reviewed yet, and its findings may change.
Published in medRxiv (preprint). The abstract is shown as published and remains the work of its authors; read the full article at the source.
Prognia lists this article for reference and education. It is not medical advice. Always read the original and follow current guidelines and local protocols before acting on it.
