Journal of Pathology Informatics

ORIGINAL ARTICLE
Year
: 2021  |  Volume : 12  |  Issue : 1  |  Page : 5-

Effects of image quantity and image source variation on machine learning histology differential diagnosis models


Elham Vali-Betts1, Kevin J Krause1, Alanna Dubrovsky2, Kristin Olson1, John Paul Graff1, Anupam Mitra1, Ananya Datta-Mitra1, Kenneth Beck1, Aristotelis Tsirigos3, Cynthia Loomis3, Antonio Galvao Neto4, Esther Adler3, Hooman H Rashidi1 
1 Department of Pathology and Laboratory Medicine, University of California Davis School of Medicine, Sacramento, CA, USA
2 Department of Psychiatry, Oregon Health and Science University, Portland, OR, USA
3 Department of Psychiatry, School of Medicine, New York University, New York, NY, USA
4 Department of Pathology, University of Colorado, Boulder, CO, USA

Correspondence Address:
Hooman H Rashidi
4400 V Street, Sacramento, CA 95817
USA
Dr. Kevin J Krause
B.S. Degree, Biomedical Engineering, 4400 V Street, Sacramento, CA 95817
USA

Aims: Histology, the microscopic study of normal tissues, is a crucial element of most medical curricula. Learning tools focused on histology are very important to learners who seek diagnostic competency within this important diagnostic arena. Recent developments in machine learning (ML) suggest that certain ML tools may be able to benefit this histology learning platform. Here, we aim to explore how one such tool based on a convolutional neural network, can be used to build a generalizable multi-classification model capable of classifying microscopic images of human tissue samples with the ultimate goal of providing a differential diagnosis (a list of look-alikes) for each entity. Methods: We obtained three institutional training datasets and one generalizability test dataset, each containing images of histologic tissues in 38 categories. Models were trained on data from single institutions, low quantity combinations of multiple institutions, and high quantity combinations of multiple institutions. Models were tested against withheld validation data, external institutional data, and generalizability test images obtained from Google image search. Performance was measured with macro and micro accuracy, sensitivity, specificity, and f1-score. Results: In this study, we were able to show that such a model's generalizability is dependent on both the training data source variety and the total number of training images used. Models which were trained on 760 images from only a single institution performed well on withheld internal data but poorly on external data (lower generalizability). Increasing data source diversity improved generalizability, even when decreasing data quantity: models trained on 684 images, but from three sources improved generalization accuracy between 4.05' and 18.59'. Maintaining this diversity and increasing the quantity of training images to 2280 further improved generalization accuracy between 16.51' and 32.79'. Conclusions: This pilot study highlights the significance of data diversity within such studies. As expected, optimal models are those that incorporate both diversity and quantity into their platforms.s


How to cite this article:
Vali-Betts E, Krause KJ, Dubrovsky A, Olson K, Graff JP, Mitra A, Datta-Mitra A, Beck K, Tsirigos A, Loomis C, Neto AG, Adler E, Rashidi HH. Effects of image quantity and image source variation on machine learning histology differential diagnosis models.J Pathol Inform 2021;12:5-5


How to cite this URL:
Vali-Betts E, Krause KJ, Dubrovsky A, Olson K, Graff JP, Mitra A, Datta-Mitra A, Beck K, Tsirigos A, Loomis C, Neto AG, Adler E, Rashidi HH. Effects of image quantity and image source variation on machine learning histology differential diagnosis models. J Pathol Inform [serial online] 2021 [cited 2021 Mar 7 ];12:5-5
Available from: https://www.jpathinformatics.org/article.asp?issn=2153-3539;year=2021;volume=12;issue=1;spage=5;epage=5;aulast=Vali-Betts;type=0