Document Type : Original Research

Authors

1 PhD, Department of Health Information Management, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran

2 PhD, Department of Health Information Technology, School of Allied Medical Sciences, Lorestan University of Medical Sciences, Khorramabad, Iran

3 MSc, Department of Health Information Management, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran

4 PhD, Amol Faculty of Paramedical Sciences, Mazandaran University of Medical Sciences, Sari, Iran

5 MD, Department of Cardiology, Pars Hospital, Tehran, Iran

6 MSc, Department of Robotic Engineering, Shahrood University of Technology, Shahrood, Iran

10.31661/jbpe.v0i0.2011-1235

Abstract

Background: Postoperative infection in Coronary Artery Bypass Graft (CABG) is one of the most common complications for diabetic patients, due to an increase in the hospitalization and cost. To address these issues, it is necessary to apply some solutions. 
Objective: The study aimed to the development of a Clinical Decision Support System (CDSS) for predicting the CABG postoperative infection in diabetic patients.
Material and Methods: This developmental study is conducted on a private hospital in Tehran in 2016. From 1061 CABG surgery medical records, we selected 210 cases randomly. After data gathering, we used statistical tests for selecting related features. Then an Artificial Neural Network (ANN), which was a one-layer perceptron network model and a supervised training algorithm with gradient descent, was constructed using MATLAB software. The software was then developed and tested using the receiver operating characteristic (ROC) diagram and the confusion matrix. 
Results: Based on the correlation analysis, from 28 variables in the data, 20 variables had a significant relationship with infection after CABG (P<0.05). The results of the confusion matrix showed that the sensitivity of the system was 69%, and the specificity and the accuracy were 97% and 84%, respectively. The Receiver Operating Characteristic (ROC) diagram shows the appropriate performance of the CDSS.  
Conclusion: The use of CDSS can play an important role in predicting infection after CABG in patients with diabetes. The designed software can be used as a supporting tool for physicians to predict infections caused by CABG in diabetic patients as a susceptible group. However, other factors affecting infection must also be considered for accurate prediction.

Keywords

Introduction

Cardiovascular disease is one of the most important threats to human health [ 1 ], and Coronary Artery Disease (CAD) is one of the most dangerous types of heart diseases in developed countries [ 2 ]. Different treatment depends on amount of obstruction of coronary arteries. Those patients diagnosed with CAD may be treated by Coronary Artery Bypass Graft (CABG), which is a surgical procedure for treating coronary heart disease to improve blood flow supply to the heart [ 3 , 4 ].

Heart operation is one of the very important surgeries that need the patient to be hospitalized for about a week, even a couple of days in Coronary Care Unit (CCU) [ 5 ]. Postoperative infection is one of the most dangerous complications, which may increase hospitalization between 5 and 20 days and change dressings up to 2-3 times per day, i.e. the hospital cost will increase [ 6 , 7 ]. Surgical wound infections may be caused by bacteria during operation or post operation, and it may also put the patients into serious issues like difficulty in rehabilitation process, sepsis, organ injury or even death [ 8 ].

Diabetes is one of the main common causes of postoperative infection in heart surgeries, and it is also a reason for coronary atherosclerosis, decreasing the chance of the treatment and increasing the side effect [ 9 ]. Identify the possibility of CABG in early-stage has a critical rule to control and decrease the chance of suffering from the possible disease in such a group of patients [ 10 ]. This group of patients need to be identified before the heart surgery operates to decrease any chance of post-surgery infection [ 11 ]. Clinical Decision Support System (CDSS) is a powerful tool to predict the possibility of postoperative infection, especially in CABG [ 12 , 13 ].

CDSS helps to predict, identify, and diagnose the diseases in a short time especially in diseases, which its diagnose needs more time, cost and complicated tests [ 14 , 15 ]. Decision making is a cognitive process, involves gathering information, evaluating situations, generating and selecting proposals, and implementing solutions. The decision support system is often used by decision-makers to reduce cognitive errors and maximize the efficiency of actions. A decision support system is a computer-based information system designed to support corporate and business decision-making activities [ 16 ]. The expansion of knowledge in the medical field and the complexity of diagnosis and treatment decisions have drawn the attention of experts to use decision support systems in various diseases, and therapies [ 17 - 19 ]. In recent years, the intelligence systems, such as CDSS, have been used to assist in the delivery of health care for various purposes in cardiovascular surgery, as well as the complications of diabetes [ 20 ]. The use of machine learning algorithms is very sensitive and specific to the diagnosis of coronary artery disease [ 21 , 22 ]. Pimentel et al. pointed out the important and effective role of machine learning algorithms in the early detection of coronary heart disease in patients with diabetes [ 23 ].

Gatti et al. examined some statistical models to predict the CABG infection, and conducted the statistical models that can’t predict postoperative infection after CABG completely [ 24 ]. Due to high priority of CDSS and high possibility risk of infection after CABG especially in diabetic patients, this study aimed at developing a CDSS to predict postoperative infection after CABG diabetic patients.

Material and Methods

In this developmental study, the study population included CABG medical records in patients with diabetes from 2009 to 2013. From 1061 records, 210 were selected through simple random sampling. Data gathering was done using a data extraction form, divided into three main sections: preoperative, intraoperative, and postoperative. It should be noted that all stages of the study were carried out without regard to the names of the individuals.

The research variables are in three main categories:

A) Preoperative research variables:

Gender, type 2 diabetes, over-weight, age, Chronic Obstructive Pulmonary Disease (COPD), history of infection in other parts of the body, wounds elsewhere in the body, positive nose culture staphylococcus carrier, history of diseases, causing immune deficiency, chronic renal failure, and dialysis, duration of corticosteroid medication (like a patient that becomes chemotherapy), test result, history of heart disease, being a smoker, blood pressure, blood sugar, and Hemoglobin A1c (HBA1C) test result.

B) Intraoperative research variables:

Operation time, pumping time, number of grafts, and the use of mammary artery.

C) Postoperative research variables:

The number and the type of antibiotics after surgery, post-operative events (including respiratory failure), intubation time, length of stay in ICU.

To exclude ineffective variables on infection from CABG in the data extraction form, an initial analysis was performed using the One-Way-ANOVA test.

Given the important role of Artificial Neural Network (ANN) and different therapeutic applications than other artificial intelligence algorithms [ 25 , 26 ], and its ability to learn easier, in this study, ANN was used. The ANN can detect the hidden aspects of science and hidden relationships between actual inputs and outputs [ 27 ].

For designing and implementing a neural network, the first step is to choose the right neural network for this task. To implement this network, the functions, available in MATLAB software, were used. The patients are supposed to be divided into infections and non-infections categories according to the data using an ANN.

One of the most suitable networks to solve the categorization problem is the perceptron neural network. In this study, a perceptron network with one hidden layer was used. In this network, there is a hidden layer and output layer, as shown in Figure 1.

Figure 1. The neural network model used in the study

A gradient descent algorithm, used in this research, guarantees that error function does not go through the incremental process of learning, and it also generally results in faster convergence by comparing this algorithm with batch gradient descent techniques and conjugating gradient algorithms.

The designed network consists of a layer with 10 nodes and a gradient descent algorithm for training. Because the system can be used for those who do not have specialized programming knowledge, the appropriate interface was defined, designed and implemented based on selective neural network and topological structure by the user interface based on the MATLAB graphics module. Eventually, the trained network was saved and used in Graphical User Interface (GUI) designed for the program. To test the CDSS, system performance analysis was performed using the confusion matrix (sensitivity, specificity, and accuracy) (Equations 1 to 3) and the ROC chart.

1) Sensitivity=TPTP+FN

2) Specificity=TNFP+TN

3) Accuracy=TP+TNTP+TN+FP+FN

Results

From 1061 records of CABG with diabetes, 210 cases were selected. From the 210 cases reviewed, 94 cases were women and the rest were men, and the mean age of patients was 61.07.

Table 1 shows the distribution of postoperative infection status by gender.

Infected and diabetic Infected and non-diabetic All infections Disinfected and diabetic Disinfected and non-diabetic All non-infections Total
percent frequency percent Frequency percent frequency percent frequency percent frequency percent frequency
Women 94 21.78 44 17.69 23 29.17 21 37.5 3 50 2 25 1
Men 116 78.22 158 82.31 107 70.83 51 62.1 5 50 2 75 3
Total 210 202 130 72 8 4 4
Table 1.Post Coronary Artery Bypass Graft (CABG) infection status by gender and diabetes status

For developing the CDSS, we used most important variables which are effective in postoperative CABG infection by the statistical tests include over-weight, age, COPD, positive nose culture (staphylococcus carrier), test results, history of hospitalization in intensive care units, history of surgery, history of cardiac surgery, history of heart disease, blood sugar, operation time (duration of operation), pump time and length of stay in the ICU (P<0.05).

To design software based on the network analysis, the variables were used as study variables.

Descending gradient methods were widely used to train this ANN. After executing the program and completing the training and testing process, the results were obtained as seen in Table 2, comparing two different values of the number of hidden layers for 500 repetitions, and its effect on the accuracy of the algorithm. The results also showed that increasing the repetition caused the model overfit.

Number of hidden layers neurons Percentage of training accuracy Percentage accuracy of test phase
10 99 92.9
8 97.5 91.3
Table 2.Comparison of the effect of different amounts of hidden layer neurons on program accuracy for a maximum of 500 iterations.

After creating and approving the final model, the interface was designed for CDSS to predict postoperative infection CABG in diabetic patients.

Table 3 shows the confusion matrix of the model, calculated by applying the test data set.

Creating an infection No infection Total rows
Creating an infection 28 1 29
No infection 12 39 51
Total columns 40 40 81
Table 3.Confusion matrix by applying the test set data.

After designing, the system evaluation was done, based on the results of software testing using Equations 1, 2 and 3, and the sensitivity of software, specificity and detection accuracy were calculated 69%, 97%, 84%, respectively. Figure 2 shows the ROC (Receiver Operating Characteristic) diagram.

Figure 2. Selected network receiver operating characteristic (ROC) curve associated with the test data set.

The paper functioning of the diagnostic system for patients with postoperative CABG infection has demonstrated curved behaviour and given the appropriate line spacing of the graph to the central line.

Figure 3 showed the user interface (UI) of developed CDSS.

Figure 3. The appropriate user interface (UI) of the clinical decision support system (CDSS).

Discussion

CABG infection can be predicted with good accuracy using the accurate data in CDSS. In the present study, variables affecting postoperative CABG infection in diabetic patients were identified based on the previous studies [ 28 , 29 ].

The use of artificial intelligence tools has an important role in predicting the complications of diabetes and can be also used as a powerful supporting tool [ 30 ]. Due to the high importance of using ANN algorithms in classifying data, we used it to construct the CDSS for predicting infection after CABG in diabetic patients.

In a study, Esmaeily et al. compared the performance of data mining algorithms to identify risk factors for type 2 diabetes and found that the ANN algorithms perform better than Support Vector Machine (SVM) and Multiple Logistic Regression(MLR) algorithms (Specificity=81.2%, sensitivity=63%, and accuracy= 78.7%) [ 31 ]. Also, Adawi et al. compared the application of ANN and bivariate logistic regression in their studies in predicting the diagnosis of patients with hypertension and diabetes and selected the ANN algorithm as the most appropriate algorithm [ 32 ]. Fisher et al. used the neural network in a study of a web-based system to detect and differentiate strabismus species in Liverpool in 2009 [ 33 ]. This system is web-based and the physician can easily enter information after a patient examination. In this study, a multilayer perceptron algorithm was used to train the data [ 33 ], which was similar to the neural network structure used in the present study.

The problem in this study (predicting of post-operative infection in CABG in patients with diabetes) is resolved with an ANN, developed by a Multi-Layer Perceptron (MLP) because it is easier to implement and train against other methods. The results of software testing were calculated for software sensitivity 69%, specificity 97%, and detection accuracy of 84%.

A study was performed by Ghaderzadeh et al. to design an ANN-based CDSS for early detection of prostate cancer from benign enlargement of the prostate that system performance analysis was performed by the confocal matrix and the ROC graph. In this study, the sensitivity of the decision system is 92.11 and its specificity was 97.06 that has a high percentage, overall, for all cases, the system could accurately detect 94.44 all cases of cancer and benign enlargement [ 14 ].

Shahmoradi et al. used MLP as an ANN algorithm as it was the most efficient algorithm for predicting acute appendicitis with accuracy 92.90%, sensitivity=80%, and specificity=97.5% [ 34 ], which in terms of the obtained indices corresponds to the present results.

It should be noted that the reason for the sensitivity amount (80%) of software against other two indices can be due to the lack of the data on patients with infection; that can be helpful in identifying people who are infected. We used of high-level coding to developing the CDSS by MATLAB, which is a functional and multifunctional language with many capabilities.

This advantage makes it possible to integrate the designed system across different user environments and operating systems by the expert system interface program that the designer is limited and depends on its environment. The high performance of the system is also remarkable, considering the small number of records. In future studies, a better prediction pattern and ultimately a higher performance CSSD whit a higher volume of data will likely be obtained.

Considering that more information is needed to design this system, including the use of High-Efficiency Particulate Air (HEPA) filters and non-control of dressing set date, proper handwashing and disinfection, sterile operating room control, and sterile quality control of the operating room and medical equipment, it is recommended that these cases be recorded in the patient medical records. Many patients get information after surgery, but the problem is solved outpatient or even referred to other centres; thus, the number of patients with postoperative infection may not be accurate. It is recommended to follow up on the complications of high-risk surgery in hospitals for recording in the patient medical records.

Conclusion

The designed CDSS in this study can be used for all patients, who have undergone CABG surgery, in addition to diabetic patients to make a timely decision on the right opportunity to deal with nosocomial infections. The use of a large statistical community can increase the reliability of this system. The increase in performance indicators, including the accuracy of diagnoses, it has been widely used and encouraged other physicians to use it.

The software designed for this study can be provided as a supporting tool for physicians to prevent CABG infections in the diabetic patient as a sensitive and susceptible group to infection. However, other factors mentioned in the system should be considered as they can increase the sensitivity of the software to make more accurate diagnoses. Given the limited information about patients undergoing CABG surgery, it is recommended that authorities make the necessary decisions to create a specialized registry for this surgical procedure to provide the basis for extensive research in this field.

Acknowledgment

This study is extracted from a MSc dissertation in Health Information Technology by support of the Tehran University of Medical Sciences with [grant number 67F/3/280].

Authors’ Contribution

M. Ghazisaeedi and L. Shahmoradi conceived the idea. The introduction of the paper was written by M. Ghazisaeedi, L. Shahmoradi, A. Garavand and M. Maleki. Sh. Abhari and S. Mehdizadeh gather the data and the related literature and also help with the writing of the related works. The method implementation was carried out by A. Garavand, S. Mehdizadeh, and M. Maleki. Results and Analysis were carried out by M. Ghazisaeedi, L. Shahmoradi, and M. Ladan. The research work was proofread and supervised by M. Ghazisaeedi L. Shahmoradi L. All the authors read, modified, and approved the final version of the manuscript.

Ethical Approval

Not applicable, because this article does not contain any studies with human or animal subjects or clinical interventions.

Conflict of Interest

None

References

  1. Van Der Kooy K, Van Hout H, Marwijk H, Marten H, Stehouwer C, Beekman A. Depression and the risk for cardiovascular diseases: systematic review and meta analysis. Int J Geriatr Psychiatry. 2007; 22(7):613-26. DOI | PubMed
  2. Ahmadi N, Nabavi V, Hajsadeghi F, Flores F, French WJ, Mao SS, et al. Mortality incidence of patients with non-obstructive coronary artery disease diagnosed by computed tomography angiography. Am J Cardiol. 2011; 107(1):10-6. DOI | PubMed
  3. Bergvik S, Sørlie T, Wynn R. Approach and avoidance coping and regulatory focus in patients having coronary artery bypass graft surgery. J Health Psychol. 2010; 15(6):915-24. DOI | PubMed
  4. Capodanno D, Capranzano P, Di Salvo ME, Caggegi A, Tomasello D, Cincotta G, et al. Usefulness of SYNTAX score to select patients with left main coronary artery disease to be treated with coronary artery bypass graft. JACC Cardiovasc Interv. 2009; 2(8):731-8. DOI | PubMed
  5. SSM Health. What should I expect during open heart surgery? 2019 [Cited 2019 May 11]. Available from: https://www.medicalnewstoday.com/articles/312888.php.
  6. Sax H, Bloemberg G, Hasse B, Sommerstein R, Kohler P, Achermann Y, et al. Prolonged outbreak of Mycobacterium chimaera infection after open-chest heart surgery. Clinical Infectious Diseases. 2015; 61(1):67-75. DOI | PubMed
  7. Smith AE, Nugent CD, McClean SI. Evaluation of inherent performance of intelligent medical decision support systems: utilising neural networks as an example. Artif Intell Med. 2003; 27(1):1-27. DOI | PubMed
  8. Banbury MK. Experience in prevention of sternal wound infections in nasal carriers of Staphylococcus aureus. Surgery. 2003; 134(5):S18-22. DOI | PubMed
  9. Kogan A, Ram E, Levin S, Fisman EZ, Tenenbaum A, Raanani E, et al. Impact of type 2 diabetes mellitus on short- and long-term mortality after coronary artery bypass surgery. Cardiovasc Diabetol. 2018; 17(1):151. Publisher Full Text | DOI | PubMed
  10. Koochemeshki V, Salmanzadeh HR, Sayyadi H, Amestejani M, Ardabili SS. The effect of diabetes mellitus on short term mortality and morbidity after isolated coronary artery bypass grafting surgery. Int J Cardiovasc Res. 2013; 7(2):41. Publisher Full Text | PubMed
  11. Kowalewski M, Pawliszak W, Zaborowska K, Navarese EP, Szwed KA, Kowalkowska ME, et al. Gentamicin-collagen sponge reduces the risk of sternal wound infections after heart surgery: meta-analysis. J Thorac Cardiovasc Surg. 2015; 149(6):1631-40. DOI | PubMed
  12. Ross JJ, Denai MA, Mahfouf M. A hybrid hierarchical decision support system for cardiac surgical intensive care patients. Part II. Clinical implementation and evaluation. Artif Intell Med. 2009; 45(1):53-62. DOI | PubMed
  13. Zaleski J. Medical Device Data and Modeling for Clinical Decision Making. Artech House: Boston; 2011.
  14. Ghaderzadeh M. Clinical decision support system for early detection of prostate cancer from benign hyperplasia of prostate. Stud Health Technol Inform. 2013; 192:928. PubMed
  15. Sim LLW, Ban KHK, Tan TW, Sethi SK, Loh TP. Development of a clinical decision support system for diabetes care: A pilot study. PloS One. 2017; 12(2)Publisher Full Text | DOI | PubMed
  16. Haynes RB, Wilczynski NL, Team CCDSSSR. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: methods of a decision-maker-researcher partnership systematic review. Implement Sci. 2010; 5(1):12. Publisher Full Text | DOI | PubMed
  17. Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ (Clinical Research ed). 2005; 330(7494):765. Publisher Full Text | DOI | PubMed
  18. Chan SS, Francavilla ML, Iyer RS, Rigsby CK, Kurth D, Karmazyn BK. Clinical decision support: the role of ACR Appropriateness Criteria. Pediatr Radiol. 2019; 49(4):479-85. DOI | PubMed
  19. Aslani N, Ahmadi M, Samadbeik M. A systematic review of the attributes of electronic personal health Records for Patients with multiple sclerosis. Health Technol (Berl). 2020; 10(3):587-99. DOI
  20. Hussain M, Khattak AM, Khan WA, Fatima I, Amin MB, Pervez Z, et al. Cloud-based Smart CDSS for chronic diseases. Health Technol (Berl). 2013; 3(2):153-75. DOI
  21. Hampe N, Wolterink JM, Van Velzen SG, Leiner T, Išgum I. Machine Learning for Assessment of Coronary Artery Disease in Cardiac CT: A Survey. Front Cardiovasc Med. 2019; 6:172. Publisher Full Text | DOI | PubMed
  22. Martin-Isla C, Campello VM, Izquierdo C, Raisi-Estabragh Z, Baeßler B, Petersen SE, et al. Image-Based Cardiac Diagnosis With Machine Learning: A Review. Front Cardiovasc Med. 2020; 7:1. DOI
  23. Pimentel A, Gamboa H, Almeida IM, Matos P, Ribeiro RT, Raposo J. Coronary heart disease prognosis using machine-learning techniques on patients with type 2 Diabetes Mellitus. IGI Global; 2018. DOI
  24. Gatti G, Rochon M, Raja S, Luzzati R, Dreas L, Pappalardo A. Predictive models of surgical site infections after coronary surgery: insights from a validation study on 7090 consecutive patients. J Hosp Infect. 2019; 102(3):277-86. DOI | PubMed
  25. Zarkogianni K, Vazeou A, Mougiakakou SG, Prountzou A, Nikita KS. An insulin infusion advisory system based on autotuning nonlinear model-predictive control. IEEE Trans Biomed Eng. 2011; 58(9):2467-77. DOI | PubMed
  26. Mirsharif M, Rouhani S. Data Mining Approach based on Neural Network and Decision Tree Methods for the Early Diagnosis of Risk of Gestational Diabetes Mellitus. Journal of Health and Biomedical Informatics. 2017; 4(1):59-68.
  27. Patel JL, Goyal RK. Applications of artificial neural networks in medical science. Curr Clin Pharmacol. 2007; 2(3):217-26. DOI | PubMed
  28. Ghumbre SU, Ghatol AA. An intelligent system for hepatitis b disease diagnosis. Int J Comput Appl. 2010; 32(4):455-60. DOI
  29. Sistani S, Norouzi S, Hassibian MR, Tara M, Tabesh H, Hasibian S, et al. The Discovery of Major Heart Risk Factors among Young Patients with Ischemic Heart Disease Using K-Means Techniques. Int Cardiovasc Res J. 2019; 13(3):85-90.
  30. Contreras I, Vehi J. Artificial intelligence for diabetes management and decision support: literature review. J Med Internet Res. 2018; 20(5):e10775. Publisher Full Text | DOI | PubMed
  31. Esmaeily H, Tayefi M, Ghayour-Mobarhan M, Amirabadizadeh A. Comparing three data mining algorithms for identifying the associated risk factors of type 2 diabetes. Iran Biomed J. 2018; 22(5):303. Publisher Full Text | DOI | PubMed
  32. Adavi M, Salehi M, Roudbari M. Artificial neural networks versus bivariate logistic regression in prediction diagnosis of patients with hypertension and diabetes. Med J Islam Repub Iran. 2016; 30:312. Publisher Full Text | PubMed
  33. Fisher AC, Lake SP, Cunningham IP, Chandna A. Web-StrabNet: a web-based expert system for the differential diagnosis of vertical strabismus (squint). Comput Math Methods Med. 2010; 11(1):89-97. DOI
  34. Shahmoradi L, Safdari R, Mirhosseini MM, Arji G, Jannat B, Abdar M. Predicting Risk of Acute Appendicitis: A Comparison of Artificial Neural Network and Logistic Regression Models. Acta Med Iran. 2018;784-95.