Auxiliary diagnosis study of integrated electronic medical record text and CT images

• Main Authors: Hang, D. (Author), Kailin, L. (Author), Shi, L. (Author), Yijie, F. (Author), Yuanchuan, D. (Author)
• Format: Article
• Language: English
• Published: De Gruyter Open Ltd 2022
• Subjects: Bi-LSTM model; Classification (of information); Computed tomographic; Computer aided diagnosis; Computerized tomography; Diagnosis model; Fusion classification; fusion features; Fusion features; Googlenet model; GoogleNet model; Image enhancement; Image fusion; Integrated electronics; Long short-term memory; Medical computing; Medical imaging; Medical record; Medical-assisted diagnose; medical-assisted diagnosis; Multilayer neural networks; Network layers; Text processing; Tomographic images
• Online Access: View Fulltext in Publisher

 At present, most of the research in the field of medical-assisted diagnosis is carried out based on image or electronic medical records. Although there is some research foundation, they lack the comprehensive consideration of comprehensive image and text modes. Based on this situation, this article proposes a fusion classification auxiliary diagnosis model based on GoogleNet model and Bi-LSTM model, uses GoogleNet to process brain computed tomographic (CT) images of ischemic stroke patients and extract CT image features, uses Bi-LSTM model to extract the electronic medical record text, integrates the two features using the full connection layer network and Softmax classifier, and obtains a method that can assist the diagnosis from two modes. Experiments show that the proposed scheme on average improves 3.05% in accuracy compared to individual image or text modes, and the best performing GoogleNet + Bi-LSTM model achieves 96.61% accuracy; although slightly less in recall, it performs better on F1 values, and has provided feasible new ideas and new methods for research in the field of multi-model medical-assisted diagnosis. © 2022 Duan Yuanchuan et al., published by De Gruyter.