Breast Histopathology Images Multi-Classification using Ensemble of Deep Convolutional Neural Networks

S.P. Akinrinwa¹ , O. Olabode² , O.C. Agbonifo³ , K.G. Akintola⁴

1. Department of Information Technology, Federal University of Technology, Akure, Nigeria.
2. Department of Information Systems, Federal University of Technology, Akure, Nigeria.
3. Department of Software Engineering, Federal University of Technology, Akure, Nigeria.

Section:Research Paper, Product Type: Journal-Paper
Vol.10 , Issue.6 , pp.9-21, Dec-2022

Online published on Dec 31, 2022

Copyright © S.P. Akinrinwa, O. Olabode, O.C. Agbonifo, K.G. Akintola . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
 

View this paper at   Google Scholar | DPI Digital Library

XML View     PDF Download

How to Cite this Paper

201 Views    226 Downloads    37 Downloads

Abstract :
Breast cancers have constituted a major health challenge as a leading cause of mortality in women. This has led to several interventions in the diagnosis and treatment of the disease. The digital classification and analysis of breast histopathology images provides a means for computerized-clinical diagnosis of breast cancers. In this study, three separate models based on the ensembles of Convolutional Neural Networks (CNNs) for the analysis and classification of histopathological images of breast tissue are presented. The ensembles make use of majority voting, averaging, and stacking techniques. The ensemble models seek to extend the performance of existing CNNs by combining AlexNet, VGGNet and ResNet using majority voting, averaging, and stacking ensemble rules. Furthermore, a model for classification of breast histopathology images was developed called the SaduNet model. This model was developed with few numbers of convolutional neural network layers to reduce computational cost in terms of memory and improve computation time. All the models were trained with histopathology images dataset collected at the Federal Teaching Hospital, Ido Ekiti, Ekiti state, Nigeria, with ethical clearance to ensure that the research is applicable locally. Different learning parameters were used in the different convolutional neural networks developed to ensure that they obtain optimal performances of the models on the histopathology images classification task. The comparative analysis performed showed that the developed models performed as well as those found in literature judging by the accuracies achieved. The ensemble methods also performed better in the terms of the sensitivity and predictability than the individual base models. This is shown in the high prediction and recall values obtained by the ensemble models. During testing, the base models generated the following accuracies: AlexNet: 92.91%, VGG16: 96.28% and ResNet: 99.25%. When tested with the FTH breast histopathology data, the averaging ensemble has accuracy of 99.47% while the majority voting ensemble has accuracy of 99.30% and stacking ensemble model has accuracy of 97.86%. The SaduNet model also achieved an accuracy of 75.89%.

Key-Words / Index Term :
Classification, Convolutional Neural Network, Histopathology Images, Deep learning, Ensemble

References :
[1] A. Mashi, "Assessing Breast Cancer Burden amongst Women at General Hospital Katsina, State Nigeria.," International Journal of Social and Humanities Sciences (IJSHS), vol. 4, no. 1, pp. 95-114, 2020.
[2] L. Elfatimi and H. Boucheneb, "rain Tumor Detection using Cellular Automata based image Segmentation techniques," International Journal of Scientific Research in Computer Science and Engineering, vol. 10, no. 5, pp. 22-36, 2022.
[3] J. Qu, N. Hiruta, K. Terai, H. Nosato, M. Murakawa and H. Sakanashi, "Gastric Pathology Image Classification Using Stepwise Fine-Tuning for Deep Neural Networks," Journal of Healthcare Engineering, pp. 1-13, 2018.
[4] M. A. Alnafea, "Detection and Diagnosis of Breast Diseases," in Breast Imaging, IntechOpen, 2017.
[5] M. H. Vorteile and G. d. Brust-Ultraschalldiagnostik, "Advantages and limitations of breast ultrasound," Gynakol Geburtshilfliche Rundsch, vol. 42, no. 4, pp. 185-190, 2002.
[6] H. Mohan, Textbook of Pathology, New Delhi: JAYPEE BROTHERS MEDICAL PUBLISHERS (P) LTD, 2010.
[7] G. Orchard and B. Nation, Histopathology, 2nd ed., Oxford University Press, 2017.
[8] M. Kowal, P. Filipczuk, A. Obuchowicz, J. Korbicz and R. Monczak, “Computer-aided diagnosis of breast cancer based on ?ne needle biopsy microscopic images,” Computers in Biology and Medicine, 2013.
[9] F. A. Spanhol, L. S. Oliveira, C. Petitjean and L. Heutte, "A Dataset for Breast Cancer Histopathological Image Classi?cation," IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, vol. 63, no. 7, pp. 1455-1462, 2016.
[10] Z. Han, B. Wei, Y. Zheng, Y. Yin, K. Li and S. Li, "Breast Cancer Multi-classification from Histopathological Images with Structured Deep Learning Model," Scientific Reports, vol. 7, p. Article No 4172, 2017.
[11] K. Fukushima, "Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position," Biol Cybern, vol. 36, no. 4, p. 193–202, 1980.
[12] Y. LeCun, L. Bottou, Y. Bengio and P. Haffner, "Gradient-based learning applied to document recognition.," Proceedings of the IEEE, vol. 86, p. 2278–2324, 1998.
[13] F. Chollet, Deep Learning with Python, New York: Manning Publications Co., 2018.
[14] D. Li and J. C. Platt, "Ensemble Deep Learning for Speech Recognition," Redmond, 2014.
[15] V. E. A. A. Adeyemo, N. JhanJhi, S. Mahadevan and A. O. Balogun, "Ensemble and Deep-Learning Methods for Two-Class and Multi-Attack Anomaly Intrusion Detection: An Empirical Study," International Journal of Advanced Computer Science and Applications, vol. 10, no. 9, pp. 520-528, 2019.
[16] M. H. Motlagh, M. Jannesari, H. Aboulkheyr, P. Khosravi, O. Elemento, M. Totonchi and I. Hajirasouliha, "Breast Cancer Histopathological Image Classification: A Deep Learning Approach," biorxiv the preprint server for biology, 4 January 2018.
[17] S. D. Raut and S. A. Thorat, "Deep Learning Techniques: A Review," International Journal of Scientific Research in Computer Science and Engineering, vol. 8, no. 1, pp. 105-109, 2020.
[18] A. Krizhevsky, I. Sutskever and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," NIPS, 2012.
[19] K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," in ICLR, 2015.
[20] K. He, X. Zhang, S. Ren and J. Sun, "Deep Residual Learning for Image Recognition," in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016.
[21] G. D. Magoulas and A. Prentza, "Machine Learning in Medical Applications," in Machine Learning and Its Applications: Advanced Lectures, Berlin, Heidelberg, Springer Berlin Heidelberg, 2001.
[22] M. M. Dundar, S. Badve, G. Bilgin, V. Raykar, R. Jain, O. Sertel and M. N. Gurcan, "Computerized Classification of Intraductal Breast Lesions using," IEEE Trans Biomed Eng., vol. 58, no. 7, p. 1977–1984, 2011.
[23] Y. Jiang, L. Chen, H. Zhang and X. Xiao, "Breast cancer histopathological image classification using convolutional neural networks with small SE-ResNet module," PLoS ONE, vol. 14, no. 3, 2019.
[24] V. Gupta and A. Bhavsar, "Partially-Independent Framework for Breast Cancer Histopathological Image Classification," in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
[25] A.-A. Nahid, M. A. Mehrabi and Y. Kong, "Histopathological Breast Cancer Image Classification by Deep Neural Network Techniques Guided by Local Clustering," BioMed Research International, 2018.
[26] Y. Benhammou, S. Tabik, B. Achchab and F. Herrera, "A first study exploring the performance of the state-of-the-art CNN model in the problem of breast cancer," Morroco, 2018.
[27] D. Bardou, K. Zhang and S. M. Ahmad, "Classification of Breast Cancer Based on Histology Images Using Convolutional Neural Networks," IEEE Access, pp. 24680-24693, 2018.
[28] M. Z. Alom, C. Yakopcic, T. M. Taha and V. K. Asari, "Breast Cancer Classification from Histopathological Images with Inception Recurrent Residual Convolutional Neural Network," 2018.
[29] T. AraĂşjo, G. Aresta, E. Castro, J. Rouco, P. Aguiar, C. Eloy, A. PolĂłnia and A. Campilho, "Classification of breast cancer histology images using Convolutional Neural Networks.," PLoS ONE, vol. 12, no. 6, 2017.
[30] T. H. Vu, H. S. Mousavi, V. Monga, G. Rao and A. U. Rao, "Histopathological Image Classi?cation using Discriminative Feature-oriented Dictionary Learning," IEEE TRANSACTIONS ON MEDICAL IMAGING, vol. 35, no. 3, p. 738–751, March 2016.
[31] C.-C. Ko, C.-Y. Tsai, C.-H. Lin and L.-S. Liao, "A Computer-Aided Diagnosis System of Breast Intraductal Lesion Using Histopathological Images," in IVCNZ `14: Proceedings of the 29th International Conference on Image and Vision Computing New Zealand, 2014.
[32] J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li and L. Fei-Fei, "Imagenet: A large-scale hierarchical image database," Computer Vision and Pattern Recognition, IEEE, pp. 248-255, 2009.
[33] S. Sharma, S. Sharma and A. Athaiya, "Activation Functions in Neural Network," International Journal of Engineering Applied Sciences and Technology, vol. 4, no. 12, pp. 310-316, 2020.
[34] W. Zhi, H. W. F. Yueng, Z. Chen, S. M. Zandavi, Z. Lu and Y. Y. Chung, "Using transfer learning with convolutional neural networks to diagnose breast cancer from histopathological images," in International Conference on Neural Information Processing, 2017.
[35] S. Akbar, M. Peikari, S. Salama, S. Nofech-Mozes and A. Martel, "Transitioning between convolutional and fully connected layers in neural networks," Deep Learning in Medical Image Analysis and Multimodal Decision Support, p. 143–150, 2017.
[36] B. Wei, Z. Han, X. He and Y. Yin, "Deep learning model based breast cancer histopathological image classification," in Cloud Computing and Big Data Analysis (ICCCBDA), 2017 IEEE 2nd International Conference, 2017
[37] S. Cascianelli, R. Bello-Cerezo, F. Bianconi, B. M. Fravolini, B. Palumbo and J. N. Kather, "Dimensionality reduction strategies for cnn-based classification of histopathological images," in International Conference on Intelligent Interactive Multimedia Systems and Services, 2017.