SEM Image Classification Using CNN Architectures

Authors: G. Türkmen, Ö. Tekin, K. Kurtuluş, Y. Y. Yurtseven, M. Baran

Abstract:

A scanning electron microscope (SEM) is a type of electron microscope mainly used in nanoscience and nanotechnology areas. Automatic image recognition and classification are among the general areas of application concerning SEM. In line with these usages, the present paper proposes a deep learning algorithm that classifies SEM images into nine categories by means of an online application to simplify the process. The NFFA-EUROPE - 100% SEM data set, containing approximately 21,000 images, was used to train and test the algorithm at 80% and 20%, respectively. Validation was carried out using a separate data set obtained from the Middle East Technical University (METU) in Turkey. To increase the accuracy in the results, the Inception ResNet-V2 model was used in view of the Fine-Tuning approach. By using a confusion matrix, it was observed that the coated-surface category has a negative effect on the accuracy of the results since it contains other categories in the data set, thereby confusing the model when detecting category-specific patterns. For this reason, the coated-surface category was removed from the train data set, hence increasing accuracy by up to 96.5%.

Keywords: Convolutional Neural Networks, deep learning, image classification, scanning electron microscope.

References:

[1] Modarres, M.H., Aversa, R., Cozzini, S., Ciancio, R., Leto, A., Brandino, G.P. (2017). Neural Network for Nanoscience Scanning Electron Microscope Image Recognition. Scientific Reports, 7(1). doi: 10.1038/s41598-017-13565-z.
[2] Ul-Hamid, A. (2018) A Beginner’s Guide to Scanning Electron Microscopy. Springer, Cham. doi: 10.1007/978-3-319-98482-7_1.
[3] De Nobili, C. (2017) Deep Learning for Nanoscience Scanning Electron Microscope Image Recognition. Retrieved from https://hdl.handle.net/20.500.11767/68034
[4] Aversa, R., Modarres, M.H., Cozzini, S., Ciancio, R., Chiusole, A. (2018). The first annotated set of scanning electron microscopy images for nanoscience. Scientific Data 5(1). doi: 180172.10.1038/sdata.2018.172.
[5] Aversa, R., Coronica, P., De Nobili, C., Cozzini, S. (2020). Deep Learning, Feature Learning, and Clustering Analysis for SEM Image Classification. Data Intelligence, 2(4), 513-528. doi: 10.1162/dint_a_00062.