机构:[1]School of computer science, Guangdong Polytechnic Normal University, Guangzhou, China[2]School of Traditional Chinese Medicine, Jinan University, Guangzhou, China[3]Huidong people’s Hospital, Huizhou, China
In the domain of natural language processing, Transformers are recognized as state-of-the-art models, which opposing to typical convolutional neural networks (CNNs), do not rely on convolution layers. Instead, Transformers employ multi-head attention mechanisms as the main building block to capture long-range contextual relations between image pixels. Till recently, CNNs dominated the deep learning solutions for diabetic retinopathy grade recognition. However, spurred by the advantages of Transformers, we propose a Transformer-based method that is appropriate for recognizing the grade of diabetic retinopathy.The purposes of this work were to (i) demonstrate that the pure attention mechanism is suitable for diabetic retinopathy grade recognition and (ii) demonstrate that Transformers can replace traditional CNNs for diabetic retinopathy grade recognition.This paper proposes a Vision Transformer-based method to recognize the grade of diabetic retinopathy. Fundus images are subdivided into non-overlapping patches, which are then converted into sequences by flattening, and undergo a linear and positional embedding process to preserve positional information. Then, the generated sequence is input into several multi-head attention layers to generate the final representation. The first token sequence is input to a softmax classification layer to produce the recognition output in the classification stage.The dataset for training and testing employs fundus images of different resolutions, subdivided into patches. We challenge our method against current CNNs and extreme learning machines and achieve an appealing performance. Specifically, the suggested deep learning architecture attains an accuracy of 91.4%, specificity = 0.977-95% CI (0.951-1), precision = 0.928-95% CI(0.852-1), sensitivity = 0.926-95% CI (0.863-0.989), Quadratic weighted kappa score = 0.935, and AUC = 0.986.Our comparative experiments against current methods conclude that our model is competitive and highlight that an attention mechanism based on a Vision Transformer model is promising for the diabetic retinopathy grade recognition task. This article is protected by copyright. All rights reserved.This article is protected by copyright. All rights reserved.
基金:
Key Projects of the National Natural Science Foundation of China
(No.81630104) and by Major Project for Guang-Zhou Collaborative Innovation of
Industry-University-Research (No.201704020196).
语种:
外文
PubmedID:
中科院(CAS)分区:
出版当年[2020]版:
大类|3 区医学
小类|3 区核医学
最新[2025]版:
大类|3 区医学
小类|3 区核医学
第一作者:
第一作者机构:[1]School of computer science, Guangdong Polytechnic Normal University, Guangzhou, China
通讯作者:
通讯机构:[1]School of computer science, Guangdong Polytechnic Normal University, Guangzhou, China[*1]School of computer science, Guangdong Polytechnic Normal University, Guangzhou, China