1. MSc in Medical Informatics, Department of Health Information Management, Tehran University of Medical Sciences, Tehran Iran., 2. Assistant Professor, Bojnord University of Medical Sciences, Bojnord, Iran., 3. Department of Computer Engineering, Institute of Technology, University of Ontario, Ontario, Canada.
Artificial intelligence (AI) research within medicine is growing rapidly. AI is poised to transform medical practice. AI has been studied in several areas of healthcare and medical practice, including diagnosing, treating and caring of patients. Warfarin is one of the most commonly prescribed oral anticoagulant. Among all anticoagulants, warfarin has long been listed among the top ten drugs causing adverse drug events. Due to narrow therapeutic range and significant side effects, warfarin dosage determination becomes a challenging task in clinical practice. The purpose of this study was to determine exact dose of warfarin needed for patients with artificial heart valve using artificial neural networks (ANN).
To achieve the best model, some multi-layer perceptron ANNs were constructed with different structures. The dataset used included 846 patients who had been referred to the PT clinic in Tehran heart center in the second six months of the year 2013. Finally, the best structure of ANN for warfarin dose was investigated and used for prediction system developments. In this paper the implementation of ANNs and proposed system in MatLab environment are described.
The effectiveness of ANNs were evaluated in terms of classification performance using 10fold cross-validation procedure and the results showed that the best model is a network that has 7 neurons in its hidden layer with an average absolute error of 0.1, disturbance rate of 0.33 and regression of 0.87.
The achieved results reveal that ANN-based system is a suitable tool for warfarin dose prediction in Iranian patients with an artificial heart valve. However, no system can be guaranteed to achieve 100% accuracy, but using such methods can reduce medical errors and thereby improve health care and patient safety.
Received: 2019 November 4; Accepted: 2019 December 13
Cardiovascular disease was recorded as the leading cause in 31% of all death, with more than 17.5 million deaths each year [1]. The number of cardiovascular disease including heart disease and stroke is expected to rise to more than 23.6 million by 2030 [2]. The percentage of premature deaths (under the age of 70) from CVDs ranges from 4% in high-income countries to 42% in low-income countries [3]. Warfarin is the most widely used anticoagulant in the prevention and treatment of CVD. Warfarin is often used to prevent thrombosis and occlusion of blood flow disorders at fibrillation, Deep Venus Thrombosis (DVT), heart attacks, pulmonary embolism and heart valve replacement [4-7]. Due to large inter-individual variability in dose requirements, the warfarin dosage in anticoagulation is usually complicated and unpredictable [8, 9]. Under- or over- dosing will result in INR values outside the target range (2-3 for most conditions) and put the patient at risk of severe adverse outcomes such as bleeding or thromboembolism and it can exacerbate disease, hospitalization, and even death [4, 5, 10].
Many clinical and genetic features affect the dosage of patients [5, 9, 11] therefore, machine learning techniques can be used for the diagnosis or prediction of warfarin’s doses to help expert humans to make the best decisions [12, 13]. Artificial Neural Networks (ANNs) are one of the most important ML algorithms [14] which are apt for such applications as: first, they can incorporate large number of inputs and large number of outputs; second, they are dynamic and can be upgraded with new data sets periodically; third, they can explore the nonlinear relationship; forth, they have high generalizability [15, 16] and hence, can be used to predict warfarin dosage requirements.
In this paper, the Multilayer Perceptron (MLP) as common type of ANNs was used. Aim of this study is to find the best MLP structure based on conjugate gradient training algorithm. Then, the next step is to develop an intelligent system for prediction of optimal dose of warfarin that is suitable for Iranian adult patients with artificial heart valves.
First, a list of essential factors for warfarin dose determination was made by search the electronic databases and consultation with cardiologists. Then these factors were organized in the form of a questionnaire "Determining the importance of factors" and were given to cardiologists. Essential factors, whose method of extraction has already been published in [17] are: demographic information such as age, height and weight, and clinical information and lab test results include previous and current INR, target range of INR, previous and current dose of warfarin as output variable.
The data were extracted from the patient's medical records by using a random sampling method and was used to train and evaluate the MLP. The patients with artificial heart valves were treated in the second half of 2013 at the PT Tehran Heart Center were included.
In data preprocessing step, for each variable, missing values (31 data items) are completed by mean of that variable. Then, using the Larose normalization method, all the variables were normalized to the interval [0, 1]. In implementation step, several MLP neural networks with different number of neurons in hidden layer based on conjugate gradient training algorithm were constructed and evaluated to determine the best network for developing an intelligent system for warfarin dosing.
Data of 846 patients including age, height, weight, previous and current INR, target range of INR, previous and current dose of warfarin as output variable were extracted. MLP neural networks with different structures were implemented in the MatLab programming environment. A total of nine MLP neural networks with different number of neurons in hidden layer (2 to 10) were created based on epochs=1000, goal =0, tangent hyperbolic activation function and conjugate gradient training algorithm. The performance of different neural networks was investigated using 10-fold cross validation and the results are compared based on disturbance rate, Mean Absolute Error (MAE) and regression coefficient (R2). The results revealed that, MLP with seven neurons in hidden layer is the best model with a MAE=0.1, disturbance rate=0.33 and R2=0.87. Therefore, this neural network was chosen to design the intelligent system for warfarin dosing. Graphical User Interface (GUI) of prediction system was created by using GUIDE in MatLab environment. Fig 1 shows an overview of data entrance page of the system.
There is a large body of literature describing the development of tools to predict warfarin dose requirements for adult patient in other countries around the world. The variables included in the prediction model, the implemented methods, and the findings of related studies are shown in Table 1.
Reference | Variables | Method(s) | Findings |
---|---|---|---|
[18] | Age, Sex, Body Surface Area(BSA), Amiodarone, Smoking, deep venous thrombosis /pulmonary embolism (DVT/PE), Diabetes, Cancer, Hypertension, Stable INR, Stable Warfarin Dosage | Artificial Neural Networks, Support Vector Regression (SVR), Linear Multivariate Regression | Best model is Linear Multivariate Regression with a MAE=12.2 and RMSE=14.51 |
[19] | Age, Height, Weight, Race, Use of enzyme inducers, Use of amiodarone, Previous and current INR , CYP2C9, VKORC1 | linear regression | Model that is developed based on clinical and genetic data (MAE=8.5[confidence interval:8-9] , R2=43%) achieve better result than model that is developed based on only clinical data (MAE=9.9 [confidence interval :9.3–10.4] , R2=26%) |
[9] | Age, Weight, Height, Gender, CYP2C9, VKORC1 Amiodarone, Lupus Anticoagulant (LA) , drinking, alanine aminotransferase (ALT), Serum Creatinine (SCr), INR |
Particle Swarm Optimization (PSO)-ANN/SVR, RBF, BP, regression | PSO-ANN/SVR based on clinical and genetic factors (MSE=0.0258 , R2=60.9 %) achieve better result than model that is developed based on only clinical data (MSE=0.0316 , R2=53.2%) |
[20] | Gender, age, height, weight, Diabetes, CYP2C9, VKORC1, INR; the level of the blood alkaline phosphatase (ALP), glutamic oxaloacetic transaminase (GOT), glutamic pyruvate transaminase (GPT), thyroid-stimulating hormone (TSH), free thyroxine (FT4) and the concentration of blood Creatinine, Concomitant medication usage, Thyroid hypofunction, Thyroid stimulating hormone level, High creatinine, Free thyroxine concentration |
hierarchical stepwise multivariate linear regression | For patients who have recently undergone heart valve surgery: R2=34.1 % For patients who had been treated with warfarin more than 3 months: R2=50.2 % |
[21] | Gender, age, weight, congestive heart failure, thyrotoxicosis, or hepatic renal dysfunction, ALT, SCr and a list of medicines causing severe DDI when combined with warfarin. | k-nearest neighbors (kNN), model tree (M5), SVR, MLP, Bagged kNN, Bagged SVR, Bagged MLP, Bagged M5, Voting with 4 classifies, Bagged voting with 4 classifiers |
Best model is Bagged Voting with four classifiers with a mean absolute error (MAE)= 0.210 and standard deviation of errors (σ(E))= 0.357 |
According to previous studies, predicting warfarin dose based on clinical and demographic data only obtain performance as well as or even better than experts [18, 21]. However, Various studies have shown that adding genetic data improves the performance of prediction models [9, 19, 20], the proposed model, which predicts warfarin dose appropriately based on clinical data only, is preferred because collecting genetic data is time-consuming and costly [21]. Unfortunately, in this study, no data were available on patients' place of residence, which could be considered in future research.
1. | World Health Organization. Cardiovascular disease [Internet]. 2017 [[cited: 2019 May 15]]. Available from: [WebCite Cache] |
2. | American Heart Association. February is American Heart month [Internet]. 2017 [ [cited: 2019 Feb 10]]. Available from: [WebCite Cache] |
3. | Mendis, S.; Puska, P.; Norrving, B. Global atlas on cardiovascular disease prevention and control. Geneva: World Health Organization: 2011. |
4. | Bonow, RO. Carabello, B. de, LAC. Edmunds, LH. Fedderly, B. Freed, M. Guidelines for the management of patients with valvular heart disease. Circulation 1998 32(5):1486–582. |
5. | Rennie, LJ. Using machine learning to predict the effect of warfarin on heart patients. Pennsylvania State University; 2004. |
6. | Silverstein, A.; Silverstein, VB.; Nunn, LS. Heart Disease. Lerner Publishing Group; 2006. |
7. | Sohrabi, MK. Tajik, A. Multi-objective feature selection for warfarin dose prediction. Computational Biology and Chemistry 2017 69:126–33. [PubMed] [CrossRef] |
8. | Eriksson, N. Wadelius, M. Prediction of warfarin dose: Why, when and how?. Pharmacogenomics 2012 13(4):429–40. [PubMed] [CrossRef] |
9. | Tao, Y.; Xiang, D.; Zhang, Y.; Jiang, B. Swarm ANN/SVR-based modeling method for warfarin dose prediction in Chinese; International Conference in Swarm Intelligence; Springer; 2017. |
10. | Saffian, SM. Duffull, SB. Wright, D. Warfarin dosing algorithms under‐predict dose requirements in patients requiring≥ 7mg daily: A systematic review and meta‐analysis. Clin Pharmacol Ther 2017 102(2):297–304. [PubMed] [CrossRef] |
11. | Sharabiani, A. Bress, A. Douzali, E. Darabi, H. Revisiting warfarin dosing using machine learning techniques. Computational and mathematical methods in medicine 2015 2015:1–9. [CrossRef] |
12. | Sohrabi, MK. Tajik, A. Effective feature selection of clinical and genetic to predict warfarin dose using artificial neural network. Tehran University Medical Journal 2016 73(12):900–5. |
13. | Nielsen, PB. Lundbye-Christensen, S. van, dMM. Larsen, TB. Using a personalized decision support algorithm for dosing in warfarin treatment: A randomised controlled trial. Clinical Trials and Regulatory Science in Cardiology 2017 25:1–6. [CrossRef] |
14. | Shahmoradi, L. Langarizadeh, M. Pourmand, G. Fard, ZA. Borhani, A. Comparing three data mining methods to predict kidney transplant survival. Acta Inform Med 2016 24(5):322–7. [PubMed] [CrossRef] |
15. | Khashei, M. Bijari, M. An artificial neural network (p,d,q) model for timeseries forecasting. Expert Systems with Applications 2010 37(1):479–89. [CrossRef] |
16. | Pavani, A. Naushad, SM. Kumar, RM. Srinath, M. Malempati, AR. Kutala, VK. Artificial neural network-based pharmacogenomic algorithm for warfarin dose optimization. Pharmacogenomics 2016 17(2):121–31. [PubMed] [CrossRef] |
17. | Orooji, A. Langarizadeh, M. Aghazadeh, M. Kamkarhaghighi, M. Ghazisaiedi, M. Moghbeli, F. Dosing of warfarin in Iranian adult patients with an artificial heart valve using artificial neural networks. Journal of Payavard Salamat 2018 12(4):249–59. |
18. | Sharabiani, A.; Darabi, H.; Bress, A.; Cavallari, L.; Nutescu, E.; Drozda, K. Machine learning based prediction of warfarin optimal dosing for African American patients. Engineering; IEEE: International Conference on Automation Science; 2013. |
19. | Klein, TE. Altman, RB. Eriksson, N. Gage, BF. Kimmel, SE. International Warfarin Pharmacogenetics Consortium. Estimation of the warfarin dose with clinical and pharmacogenetic data. N Engl J Med 2009 360(8):753–64. [PubMed] [CrossRef] |
20. | Tatarunas, V. Lesauskaite, V. Veikutiene, A. Grybauskas, P. Jakuska, P. Jankauskiene, L. The effect of CYP2C9, VKORC1 and CYP4F2 polymorphism and of clinical factors on warfarin dosage during initiation and long-term treatment after heart valve surgery. J Thromb Thrombolysis 2014 37(2):177–85. [PubMed] [CrossRef] |
21. | Hu, YH. Wu, F. Lo, CL. Tai, CT. Predicting warfarin dosage from clinical data: A supervised learning approach. Artif Intell Med 2012 56(1):27–34. [PubMed] [CrossRef] |