Recent studies have introduced attention models for medical visual question answering (MVQA). In medical research, not only is the modeling of “visual attention” crucial, but the modeling of “question attention” is equally significant. To facilitate bidirectional reasoning in the attention processes involving medical images and questions, a new MVQA architecture, named MCAN, has been proposed. This architecture incorporated a cross-modal co-attention network, FCAF, which identifies key words in questions and principal parts in images. Through a meta-learning channel attention module (MLCA), weights were adaptively assigned to each word and region, reflecting the model’s focus on specific words and regions during reasoning. Additionally, this study specially designed and developed a medical domain-specific word embedding model, Med-GloVe, to further enhance the model’s accuracy and practical value. Experimental results indicated that MCAN proposed in this study improved the accuracy by 7.7% on free-form questions in the Path-VQA dataset, and by 4.4% on closed-form questions in the VQA-RAD dataset, which effectively improves the accuracy of the medical vision question answer.
Medical studies have found that tumor mutation burden (TMB) is positively correlated with the efficacy of immunotherapy for non-small cell lung cancer (NSCLC), and TMB value can be used to predict the efficacy of targeted therapy and chemotherapy. However, the calculation of TMB value mainly depends on the whole exon sequencing (WES) technology, which usually costs too much time and expenses. To deal with above problem, this paper studies the correlation between TMB and slice images by taking advantage of digital pathological slices commonly used in clinic and then predicts the patient TMB level accordingly. This paper proposes a deep learning model (RCA-MSAG) based on residual coordinate attention (RCA) structure and combined with multi-scale attention guidance (MSAG) module. The model takes ResNet-50 as the basic model and integrates coordinate attention (CA) into bottleneck module to capture the direction-aware and position-sensitive information, which makes the model able to locate and identify the interesting positions more accurately. And then, MSAG module is embedded into the network, which makes the model able to extract the deep features of lung cancer pathological sections and the interactive information between channels. The cancer genome map (TCGA) open dataset is adopted in the experiment, which consists of 200 pathological sections of lung adenocarcinoma, including 80 data samples with high TMB value, 77 data samples with medium TMB value and 43 data samples with low TMB value. Experimental results demonstrate that the accuracy, precision, recall and F1 score of the proposed model are 96.2%, 96.4%, 96.2% and 96.3%, respectively, which are superior to the existing mainstream deep learning models. The model proposed in this paper can promote clinical auxiliary diagnosis and has certain theoretical guiding significance for TMB prediction.
The incidence of tinnitus is very high, which can affect the patient’s attention, emotion and sleep, and even cause serious psychological distress and suicidal tendency. Currently, there is no uniform and objective method for tinnitus detection and therapy, and the mechanism of tinnitus is still unclear. In this study, we first collected the resting state electroencephalogram (EEG) data of tinnitus patients and healthy subjects. Then the power spectrum topology diagrams were compared of in the band of δ (0.5–3 Hz), θ (4–7 Hz), α (8–13 Hz), β (14–30 Hz) and γ (31–50 Hz) to explore the central mechanism of tinnitus. A total of 16 tinnitus patients and 16 healthy subjects were recruited to participate in the experiment. The results of resting state EEG experiments found that the spectrum power value of tinnitus patients was higher than that of healthy subjects in all concerned frequency bands. The t-test results showed that the significant difference areas were mainly concentrated in the right temporal lobe of the θ and α band, and the temporal lobe, parietal lobe and forehead area of the β and γ band. In addition, we designed an attention-related task experiment to further study the relationship between tinnitus and attention. The results showed that the classification accuracy of tinnitus patients was significantly lower than that of healthy subjects, and the highest classification accuracies were 80.21% and 88.75%, respectively. The experimental results indicate that tinnitus may cause the decrease of patients’ attention.
In clinical, manually scoring by technician is the major method for sleep arousal detection. This method is time-consuming and subjective. This study aimed to achieve an end-to-end sleep-arousal events detection by constructing a convolutional neural network based on multi-scale convolutional layers and self-attention mechanism, and using 1 min single-channel electroencephalogram (EEG) signals as its input. Compared with the performance of the baseline model, the results of the proposed method showed that the mean area under the precision-recall curve and area under the receiver operating characteristic were both improved by 7%. Furthermore, we also compared the effects of single modality and multi-modality on the performance of the proposed model. The results revealed the power of single-channel EEG signals in automatic sleep arousal detection. However, the simple combination of multi-modality signals may be counterproductive to the improvement of model performance. Finally, we also explored the scalability of the proposed model and transferred the model into the automated sleep staging task in the same dataset. The average accuracy of 73% also suggested the power of the proposed method in task transferring. This study provides a potential solution for the development of portable sleep monitoring and paves a way for the automatic sleep data analysis using the transfer learning method.
Although deep learning plays an important role in cell nucleus segmentation, it still faces problems such as difficulty in extracting subtle features and blurring of nucleus edges in pathological diagnosis. Aiming at the above problems, a nuclear segmentation network combined with attention mechanism is proposed. The network uses UNet network as the basic structure and the depth separable residual (DSRC) module as the feature encoding to avoid losing the boundary information of the cell nucleus. The feature decoding uses the coordinate attention (CA) to enhance the long-range distance in the feature space and highlights the key information of the nuclear position. Finally, the semantics information fusion (SIF) module integrates the feature of deep and shallow layers to improve the segmentation effect. The experiments were performed on the 2018 data science bowl (DSB2018) dataset and the triple negative breast cancer (TNBC) dataset. For the two datasets, the accuracy of the proposed method was 92.01% and 89.80%, the sensitivity was 90.09% and 91.10%, and the mean intersection over union was 89.01% and 89.12%, respectively. The experimental results show that the proposed method can effectively segment the subtle regions of the nucleus, improve the segmentation accuracy, and provide a reliable basis for clinical diagnosis.
Habitual snoring can occur in both children and adults. If it is physiological snoring, it usually does not require special intervention. If it is pathological snoring, such as snoring caused by central diseases and obstructive diseases, it needs to be treated as soon as possible. Habitual snoring has more harm to children, such as causing sleep structure disorders, slow growth and development. During the snoring process, children’s sleep fragmentation and hypoxia state lead to changes in the transmission of neurochemicals in the brain’s precortex, causing adverse effects on brain function and inducing attention deficit hyperactivity disorder. This article reviews relevant research in recent years to further elucidate the relationship between children’s habitual snoring and attention deficit hyperactivity disorder, and provide a basis for future clinical research and intervention.
This study aims to explore the differences of event related potential (ERP) between attention deficit hyperactivity disorder (ADHD) and normal children, so that these differences provide scientific basis for the diagnosis of ADHD. Eight children were identified to be ADHD group by the diagnostic criteria of DSM IV (diagnostic and statistical manual of mental disorders IV), and the control group also consisted of 8 normal children. Modified visual continuous performance test (CPT) was used as the experiment paradigm. The experiment included two major conditions, i.e. Go and NoGo. All the 16 subjects participated in the study. A high density EEG acquisition instrument was used to record the EEG signal and processed these EEG data by means of ERP and spectrum analysis. P2 N2 peak peak value and spectral peak around 11 Hz were analyzed between ADHD subjects and those in the control group, and then statistical tests were applied to these two groups. Results showed that: ① Under the condition of Go, ADHD group had a significant lower P2 N2 peak peak value than the values in the control group ( P< 0.05); but under the condition of NoGo there was no significant difference in between. ② Compared with the control group, the ADHD group had significant lower spectral amplitude around 11 Hz under the condition of NoGo ( P< 0.05). However, under the condition of Go the difference was insignificant. In conclusion, there is certain cognitive dysfunction in ADHD children. P2-N2 peak-peak value and spectral peak around 11 Hz could be considered as clinical evaluation indexes of ADHD children′s cognitive function. These two objective indexes provide an early diagnosis and effective treatment of ADHD .
Although attention plays an important role in cognitive and perception, there is no simple way to measure one's attention abilities. We identified that the strength of brain functional network in sustained attention task can be used as the physiological indicator to predict behavioral performance. Behavioral and electroencephalogram (EEG) data from 14 subjects during three force control tasks were collected in this paper. The reciprocal of the product of force tolerance and variance were used to calculate the score of behavioral performance. EEG data were used to construct brain network connectivity by wavelet coherence method and then correlation analysis between each edge in connectivity matrices and behavioral score was performed. The linear regression model combined those with significantly correlated network connections into physiological indicator to predict participant's performance on three force control tasks, all of which had correlation coefficients greater than 0.7. These results indicate that brain functional network strength can provide a widely applicable biomarker for sustained attention tasks.
In the clinical stage, suspected hemolytic plasma may cause hemolysis illness, manifesting as symptoms such as heart failure, severe anemia, etc. Applying a deep learning method to plasma images significantly improves recognition accuracy, so that this paper proposes a plasma quality detection model based on improved “You Only Look Once” 5th version (YOLOv5). Then the model presented in this paper and the evaluation system ?were introduced? into the plasma datasets, and ?the average accuracy of the final classification reached 98.7%?. The results of this paper's experiment were obtained through the combination of several key algorithm modules including? omni-dimensional dynamic convolution, pooling with separable kernel attention, residual bi-fusion feature pyramid network, ?and? re-parameterization convolution. The method of this paper? obtains the feature information of spatial mapping efficiently, and enhances the average recognition accuracy of plasma quality detection. This paper presents a high-efficiency detection method for plasma images, aiming to provide a practical approach to prevent hemolysis illnesses caused by external factors.
Alzheimer’s disease (AD) is a progressive and irreversible neurodegenerative disease. Neuroimaging based on magnetic resonance imaging (MRI) is one of the most intuitive and reliable methods to perform AD screening and diagnosis. Clinical head MRI detection generates multimodal image data, and to solve the problem of multimodal MRI processing and information fusion, this paper proposes a structural and functional MRI feature extraction and fusion method based on generalized convolutional neural networks (gCNN). The method includes a three-dimensional residual U-shaped network based on hybrid attention mechanism (3D HA-ResUNet) for feature representation and classification for structural MRI, and a U-shaped graph convolutional neural network (U-GCN) for node feature representation and classification of brain functional networks for functional MRI. Based on the fusion of the two types of image features, the optimal feature subset is selected based on discrete binary particle swarm optimization, and the prediction results are output by a machine learning classifier. The validation results of multimodal dataset from the AD Neuroimaging Initiative (ADNI) open-source database show that the proposed models have superior performance in their respective data domains. The gCNN framework combines the advantages of these two models and further improves the performance of the methods using single-modal MRI, improving the classification accuracy and sensitivity by 5.56% and 11.11%, respectively. In conclusion, the gCNN-based multimodal MRI classification method proposed in this paper can provide a technical basis for the auxiliary diagnosis of Alzheimer’s disease.
