Seven-Point Checklist and Skin Lesion Classification Using Multitask Multimodal Neural Nets

View Researcher's Other Codes

Disclaimer: The provided code links for this paper are external links. Science Nest has no responsibility for the accuracy, legality or content of these links. Also, by downloading this code(s), you agree to comply with the terms of use as set out by the author(s) of the code(s).

Please contact us in case of a broken link from here

Authors Jeremy Kawahara, Sara Daneshvar, Giuseppe Argenziano, Ghassan Hamarneh
Journal/Conference Name IEEE Journal of Biomedical and Health Informatics
Paper Category
Paper Abstract We propose a multitask deep convolutional neural network, trained on multimodal data (clinical and dermoscopic images, and patient metadata), to classify the 7-point melanoma checklist criteria and perform skin lesion diagnosis. Our neural network is trained using several multitask loss functions, where each loss considers different combinations of the input modalities, which allows our model to be robust to missing data at inference time. Our final model classifies the 7-point checklist and skin condition diagnosis, produces multimodal feature vectors suitable for image retrieval, and localizes clinically discriminant regions. We benchmark our approach using 1011 lesion cases, and report comprehensive results over all 7-point criteria and diagnosis. We also make our dataset (images and metadata) publicly available online at http//
Date of publication 2018
Code Programming Language Jupyter Notebook

Copyright Researcher 2022