CINXE.COM

<!DOCTYPE html> <html xmlns="http://www.w3.org/1999/xhtml" xmlns:dc="http://purl.org/dc/terms/" xmlns:doi="http://dx.doi.org/" lang="en" xml:lang="en" itemscope itemtype="http://schema.org/Article" class="no-js"> <head prefix="og: http://ogp.me/ns#"> <link rel="stylesheet" href="/resource/css/screen.css?112d78c04dc25a6fb55b68d577e0729a"/>   <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Open+Sans:400,400i,600"> <link media="print" rel="stylesheet" type="text/css" href="/resource/css/print.css"/> <script type="text/javascript"> var siteUrlPrefix = "/plosone/"; </script> <script src="/resource/js/vendor/modernizr-v2.7.1.js" type="text/javascript"></script> <script src="/resource/js/vendor/detectizr.min.js" type="text/javascript"></script> <link rel="shortcut icon" href="/resource/img/favicon.ico" type="image/x-icon"/> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"/> <link rel="canonical" href="https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0279433" /> <meta name="description" content="Objective The objective of this study is twofold. First, we seek to understand the characteristics of the multimorbid population that needs hospital care by using all diagnoses information (ICD-10 codes) and two aggregated multimorbidity and frailty scores. Second, we use machine learning prediction models on these multimorbid patients characteristics to predict rehospitalization within 30 and 365 days and their length of stay. Methods This study was conducted on 8 882 anonymized patients hospitalized at the University Hospital of Saint-Étienne. A descriptive statistical analysis was performed to better understand the characteristics of the patient population. Multimorbidity was measured using raw diagnoses information and two specific scores based on clusters of diagnoses: the Hospital Frailty Risk Score and the Calderon-Larrañaga index. Based on these variables different machine learning models (Decision Tree, Random forest and k-nearest Neighbors) were used to predict near future rehospitalization and length of stay (LoS). Results The use of random forest algorithms yielded better performance to predict both 365 and 30 days rehospitalization and using the diagnoses ICD-10 codes directly was significantly more efficient. However, using the Calderon-Larrañaga’s clusters of diagnoses can be used as an efficient substitute for diagnoses information for predicting readmission. The predictive power of the algorithms is quite low on length of stay indicator. Conclusion Using machine learning techniques using patients’ diagnoses information and Calderon-Larrañaga’s score yielded efficient results to predict hospital readmission of multimorbid patients. These methods could help improve the management of care of multimorbid patients in hospitals." /> <meta name="citation_abstract" content="Objective The objective of this study is twofold. First, we seek to understand the characteristics of the multimorbid population that needs hospital care by using all diagnoses information (ICD-10 codes) and two aggregated multimorbidity and frailty scores. Second, we use machine learning prediction models on these multimorbid patients characteristics to predict rehospitalization within 30 and 365 days and their length of stay. Methods This study was conducted on 8 882 anonymized patients hospitalized at the University Hospital of Saint-Étienne. A descriptive statistical analysis was performed to better understand the characteristics of the patient population. Multimorbidity was measured using raw diagnoses information and two specific scores based on clusters of diagnoses: the Hospital Frailty Risk Score and the Calderon-Larrañaga index. Based on these variables different machine learning models (Decision Tree, Random forest and k-nearest Neighbors) were used to predict near future rehospitalization and length of stay (LoS). Results The use of random forest algorithms yielded better performance to predict both 365 and 30 days rehospitalization and using the diagnoses ICD-10 codes directly was significantly more efficient. However, using the Calderon-Larrañaga’s clusters of diagnoses can be used as an efficient substitute for diagnoses information for predicting readmission. The predictive power of the algorithms is quite low on length of stay indicator. Conclusion Using machine learning techniques using patients’ diagnoses information and Calderon-Larrañaga’s score yielded efficient results to predict hospital readmission of multimorbid patients. These methods could help improve the management of care of multimorbid patients in hospitals."> <meta name="keywords" content="Hemorrhagic fever with renal syndrome,Machine learning,Frailty,Machine learning algorithms,Algorithms,Hospitals,Medical risk factors,Decision tree learning" /> <meta name="citation_doi" content="10.1371/journal.pone.0279433"/> <meta name="citation_author" content="Jules Le Lay"/> <meta name="citation_author_institution" content="Mines Saint-Etienne, Univ Clermont Auvergne, INP Clermont Auvergne, CNRS, UMR 6158 LIMOS, Centre CIS, Saint-Étienne France"/> <meta name="citation_author" content="Edgar Alfonso-Lizarazo"/> <meta name="citation_author_institution" content="Université de Lyon, Univ Jean Monnet Saint-Étienne, LASPI, EA3059, Saint-Étienne, France"/> <meta name="citation_author" content="Vincent Augusto"/> <meta name="citation_author_institution" content="Mines Saint-Etienne, Univ Clermont Auvergne, INP Clermont Auvergne, CNRS, UMR 6158 LIMOS, Centre CIS, Saint-Étienne France"/> <meta name="citation_author" content="Bienvenu Bongue"/> <meta name="citation_author_institution" content="Centre technique d’appui et de formation des centers d’examens de santé (CETAF), INSERM, U1059, SAINBIOSE, Dysfonction Vasculaire et Hémostase, Université de Lyon, Université Jean Monnet, Saint-Étienne, France"/> <meta name="citation_author_institution" content="Chaire Santé des Ainés, University of Jean Monnet, Saint-Étienne, France"/> <meta name="citation_author" content="Malek Masmoudi"/> <meta name="citation_author_institution" content="University of Sharjah, College of Engineering, Sharjah, United Arab Emirates"/> <meta name="citation_author" content="Xiaolan Xie"/> <meta name="citation_author_institution" content="Mines Saint-Etienne, Univ Clermont Auvergne, INP Clermont Auvergne, CNRS, UMR 6158 LIMOS, Centre CIS, Saint-Étienne France"/> <meta name="citation_author" content="Baptiste Gramont"/> <meta name="citation_author_institution" content="Department of Internal Medicine, University Hospital of Saint-Etienne, Saint-Étienne, France"/> <meta name="citation_author" content="Thomas Célarier"/> <meta name="citation_author_institution" content="Chaire Santé des Ainés, University of Jean Monnet, Saint-Étienne, France"/> <meta name="citation_author_institution" content="Department of Clinical Gerontology, University Hospital of Saint-Etienne, Saint-Étienne, France"/> <meta name="citation_author_institution" content="Gérontopôle Auvergne-Rhône-Alpes, Saint-Étienne, France"/> <meta name="citation_title" content="Prediction of hospital readmission of multimorbid patients using machine learning models"/> <meta itemprop="name" content="Prediction of hospital readmission of multimorbid patients using machine learning models"/> <meta name="citation_journal_title" content="PLOS ONE"/> <meta name="citation_journal_abbrev" content="PLOS ONE"/> <meta name="citation_date" content="Dec 22, 2022"/> <meta name="citation_firstpage" content="e0279433"/> <meta name="citation_issue" content="12"/> <meta name="citation_volume" content="17"/> <meta name="citation_issn" content="1932-6203"/> <meta name="citation_publisher" content="Public Library of Science"/> <meta name="citation_pdf_url" content="https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0279433&type=printable"> <meta name="citation_article_type" content="Research Article"> <meta name="dc.identifier" content="10.1371/journal.pone.0279433" /> <meta name="twitter:card" content="summary" /> <meta name="twitter:site" content="plosone"/> <meta name="twitter:title" content="Prediction of hospital readmission of multimorbid patients using machine learning models" /> <meta property="twitter:description" content="Objective The objective of this study is twofold. First, we seek to understand the characteristics of the multimorbid population that needs hospital care by using all diagnoses information (ICD-10 codes) and two aggregated multimorbidity and frailty scores. Second, we use machine learning prediction models on these multimorbid patients characteristics to predict rehospitalization within 30 and 365 days and their length of stay. Methods This study was conducted on 8 882 anonymized patients hospitalized at the University Hospital of Saint-Étienne. A descriptive statistical analysis was performed to better understand the characteristics of the patient population. Multimorbidity was measured using raw diagnoses information and two specific scores based on clusters of diagnoses: the Hospital Frailty Risk Score and the Calderon-Larrañaga index. Based on these variables different machine learning models (Decision Tree, Random forest and k-nearest Neighbors) were used to predict near future rehospitalization and length of stay (LoS). Results The use of random forest algorithms yielded better performance to predict both 365 and 30 days rehospitalization and using the diagnoses ICD-10 codes directly was significantly more efficient. However, using the Calderon-Larrañaga’s clusters of diagnoses can be used as an efficient substitute for diagnoses information for predicting readmission. The predictive power of the algorithms is quite low on length of stay indicator. Conclusion Using machine learning techniques using patients’ diagnoses information and Calderon-Larrañaga’s score yielded efficient results to predict hospital readmission of multimorbid patients. These methods could help improve the management of care of multimorbid patients in hospitals." /> <meta property="twitter:image" content="https://journals.plos.org/plosone/article/figure/image?id=10.1371/journal.pone.0279433.g003&size=inline" /> <meta property="og:type" content="article" /> <meta property="og:url" content="https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0279433"/> <meta property="og:title" content="Prediction of hospital readmission of multimorbid patients using machine learning models"/> <meta property="og:description" content="Objective The objective of this study is twofold. First, we seek to understand the characteristics of the multimorbid population that needs hospital care by using all diagnoses information (ICD-10 codes) and two aggregated multimorbidity and frailty scores. Second, we use machine learning prediction models on these multimorbid patients characteristics to predict rehospitalization within 30 and 365 days and their length of stay. Methods This study was conducted on 8 882 anonymized patients hospitalized at the University Hospital of Saint-Étienne. A descriptive statistical analysis was performed to better understand the characteristics of the patient population. Multimorbidity was measured using raw diagnoses information and two specific scores based on clusters of diagnoses: the Hospital Frailty Risk Score and the Calderon-Larrañaga index. Based on these variables different machine learning models (Decision Tree, Random forest and k-nearest Neighbors) were used to predict near future rehospitalization and length of stay (LoS). Results The use of random forest algorithms yielded better performance to predict both 365 and 30 days rehospitalization and using the diagnoses ICD-10 codes directly was significantly more efficient. However, using the Calderon-Larrañaga’s clusters of diagnoses can be used as an efficient substitute for diagnoses information for predicting readmission. The predictive power of the algorithms is quite low on length of stay indicator. Conclusion Using machine learning techniques using patients’ diagnoses information and Calderon-Larrañaga’s score yielded efficient results to predict hospital readmission of multimorbid patients. These methods could help improve the management of care of multimorbid patients in hospitals."/> <meta property="og:image" content="https://journals.plos.org/plosone/article/figure/image?id=10.1371/journal.pone.0279433.g003&size=inline"/> <meta name="citation_reference" content="citation_title=How to improve care for people with multimorbidity in Europe?;citation_inbook_title=European Observatory Policy Briefs;citation_author=M Rijken;citation_author=V Struckmann;citation_author=I van der Heide;citation_author=A Hujala;citation_author=F Barbabella;citation_author=E van Ginneken;citation_author=E Richardson;citation_author=E Van Ginneken;citation_publication_date=2017;citation_publisher=European Observatory on Health Systems and Policies"/> <meta name="citation_reference" content="citation_title=Comorbidity or multimorbidity: what’s in a name? A review of literature;citation_author=M van den Akker;citation_author=F Buntinx;citation_author=JA Knottnerus;citation_journal_title=European Journal of General Practice;citation_volume=2;citation_number=2;citation_issue=2;citation_first_page=65;citation_last_page=70;citation_publication_date=1996;"/> <meta name="citation_reference" content="citation_title=Disparities in multimorbidity across Europe—Findings from the SHARE Survey;citation_author=C.R Nielsen;citation_author=A Halling;citation_author=K Andersen-Ranberg;citation_journal_title=European Geriatric Medicine;citation_volume=1;citation_number=1;citation_issue=8;citation_first_page=16;citation_last_page=21;citation_publication_date=2017;"/> <meta name="citation_reference" content="citation_title=Managing multimorbidity: Profiles of integrated care approaches targeting people with multiple chronic conditions in Europe;citation_author=M Rijken;citation_author=A Hujala;citation_author=E van Ginneken;citation_author=MG Melchiorre;citation_author=P Groenewegen;citation_author=F Schellevis;citation_journal_title=Health Policy;citation_volume=122;citation_number=122;citation_issue=1;citation_first_page=44;citation_last_page=52;citation_publication_date=2018;"/> <meta name="citation_reference" content="citation_title=How to strengthen patient-centredness in caring for people with multimorbidity in Europe?;citation_inbook_title=European Observatory Policy Briefs;citation_author=I van der Heide;citation_author=SP Snoeijs;citation_author=WG Boerma;citation_author=FG Schellevis;citation_author=MP Rijken;citation_author=E Richardson;citation_author=E Van Ginneken;citation_publication_date=2017;citation_publisher=European Observatory on Health Systems and Policies"/> <meta name="citation_reference" content="citation_title=Effect of a Multidisciplinary Outpatient Model of Care on Health Outcomes in Older Patients with Multimorbidity: A Retrospective Case Control Study;citation_author=S Shakib;citation_author=BK Dundon;citation_author=J Maddison;citation_author=J Thomas;citation_author=M Stanners;citation_author=GE Caughey;citation_journal_title=PloS One;citation_volume=11;citation_number=11;citation_issue=8;citation_first_page=e0161382;citation_publication_date=2016;"/> <meta name="citation_reference" content="citation_title=Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study;citation_author=K Barnett;citation_author=SW Mercer;citation_author=M Norbury;citation_author=G Watt;citation_author=S Wyke;citation_author=B Guthrie;citation_journal_title=The Lancet;citation_volume=380;citation_number=380;citation_issue=9836;citation_first_page=37;citation_last_page=43;citation_publication_date=2012;"/> <meta name="citation_reference" content="citation_title=The Measurement of Multiple Chronic Diseases—A Systematic Review on Existing Multimorbidity Indices;citation_author=C Diederichs;citation_author=K Berger;citation_author=DB Bartels;citation_journal_title=The Journals of Gerontology: Series A;citation_volume=66A;citation_number=66;citation_issue=3;citation_first_page=301;citation_last_page=311;citation_publication_date=2010;"/> <meta name="citation_reference" content="citation_title=Measuring multimorbidity beyond counting diseases: systematic review of community and population studies and guide to index choice;citation_author=LE Stirland;citation_author=L González-Saavedra;citation_author=DS Mullin;citation_author=CW Ritchie;citation_author=G Muniz-Terrera;citation_author=TC Russ;citation_journal_title=BMJ;citation_first_page=m160;citation_publication_date=2020;"/> <meta name="citation_reference" content="citation_title=The Importance Of A Standardized Instrument To Assess The Burden Of Multimorbidity;citation_author=C Diederichs;citation_author=DB Bartels;citation_author=K Berger;citation_journal_title=The Journals of Gerontology: Series A;citation_volume=66A;citation_number=66;citation_issue=(12);citation_first_page=1395;citation_last_page=1396;citation_publication_date=2011;"/> <meta name="citation_reference" content="citation_title=A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation;citation_author=ME Charlson;citation_author=P Pompei;citation_author=KL Ales;citation_author=CR MacKenzie;citation_journal_title=Journal of Chronic Diseases;citation_volume=40;citation_number=40;citation_issue=5;citation_first_page=373;citation_last_page=383;citation_publication_date=1987;"/> <meta name="citation_reference" content="citation_title=Validation of a combined multimorbidity index;citation_author=ME Charlson;citation_author=T Szatrowski;citation_author=J Peterson;citation_author=J Gold;citation_journal_title=Journal of Clinical Epidemiology;citation_volume=47;citation_number=47;citation_issue=11;citation_first_page=1245;citation_last_page=1151;citation_publication_date=1994;"/> <meta name="citation_reference" content="citation_title=Coding Algorithms for Defining Comorbidities in ICD-9-CM and ICD-10 Administrative Data;citation_author=H Quan;citation_author=V Sundararajan;citation_author=P Halfon;citation_author=A Fong;citation_author=B Burnand;citation_author=JC Luthi;citation_journal_title=Medical Care;citation_volume=43;citation_number=43;citation_issue=11;citation_first_page=1130;citation_last_page=1139;citation_publication_date=2005;"/> <meta name="citation_reference" content="citation_title=New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality;citation_author=V Sundararajan;citation_author=T Henderson;citation_author=C Perry;citation_author=A Muggivan;citation_author=H Quan;citation_author=WA Ghali;citation_journal_title=Journal of Clinical Epidemiology;citation_volume=57;citation_number=57;citation_issue=12;citation_first_page=1288;citation_last_page=1294;citation_publication_date=2004;"/> <meta name="citation_reference" content="citation_title=Updating and Validating the Charlson Comorbidity Index and Score for Risk Adjustment in Hospital Discharge Abstracts Using Data From 6 Countries;citation_author=H Quan;citation_author=B Li;citation_author=CM Couris;citation_author=K Fushimi;citation_author=P Graham;citation_author=P Hider;citation_journal_title=American Journal of Epidemiology;citation_volume=173;citation_number=173;citation_issue=6;citation_first_page=676;citation_last_page=682;citation_publication_date=2011;"/> <meta name="citation_reference" content="citation_title=Development and validation of a Hospital Frailty Risk Score focusing on older people in acute care settings using electronic hospital records: an observational study;citation_author=T Gilbert;citation_author=J Neuburger;citation_author=J Kraindler;citation_author=E Keeble;citation_author=P Smith;citation_author=C Ariti;citation_journal_title=The Lancet;citation_volume=391;citation_number=391;citation_issue=10132;citation_first_page=1775;citation_last_page=1782;citation_publication_date=2018;"/> <meta name="citation_reference" content="citation_title=Assessing and Measuring Chronic Multimorbidity in the Older Population: A Proposal for Its Operationalization;citation_author=A Calderón-Larrañaga;citation_author=DL Vetrano;citation_author=G Onder;citation_author=LA Gimeno-Feliu;citation_author=C Coscollar-Santaliestra;citation_author=A Carfí;citation_journal_title=The Journals of Gerontology Series A: Biological Sciences and Medical Sciences;citation_publication_date=2016;"/> <meta name="citation_reference" content="citation_title=Predicting readmission risk with institution-specific prediction models;citation_author=S Yu;citation_author=F Farooq;citation_author=A van Esbroeck;citation_author=G Fung;citation_author=V Anand;citation_author=B Krishnapuram;citation_journal_title=Artificial Intelligence in Medicine;citation_volume=65;citation_number=65;citation_issue=2;citation_first_page=89;citation_last_page=96;citation_publication_date=2015;"/> <meta name="citation_reference" content="citation_title=Risk Prediction Models for Hospital Readmission: A Systematic Review;citation_author=D Kansagara;citation_author=H Englander;citation_author=A Salanitro;citation_author=D Kagen;citation_author=C Theobald;citation_author=M Freeman;citation_journal_title=JAMA;citation_volume=306;citation_number=306;citation_issue=15;citation_first_page=1688;citation_last_page=1698;citation_publication_date=2011;"/> <meta name="citation_reference" content="citation_title=The Importance of Comorbidities in Explaining Differences in Patient Costs;citation_author=M Shwartz;citation_author=LI Iezzoni;citation_author=MA Moskowitz;citation_author=AS Ash;citation_author=E Sawitz;citation_journal_title=Medical Care;citation_volume=34;citation_number=34;citation_issue=8;citation_first_page=767;citation_last_page=782;citation_publication_date=1996;"/> <meta name="citation_reference" content="Shailaja K, Seetharamulu B, Jabbar MA. Machine Learning in Healthcare: A Review. In: 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA); 2018. p. 910–914."/> <meta name="citation_reference" content="citation_title=Application of machine learning in predicting hospital readmissions: a scoping review of the literature;citation_author=Y Huang;citation_author=A Talwar;citation_author=S Chatterjee;citation_author=RR Aparasu;citation_journal_title=BMC Medical Research Methodology;citation_volume=21;citation_number=21;citation_issue=1;citation_first_page=96;citation_publication_date=2021;"/> <meta name="citation_reference" content="Al Taleb AR, Hoque M, Hasanat A, Khan MB. Application of data mining techniques to predict length of stay of stroke patients. In: 2017 International Conference on Informatics, Health Technology (ICIHT); 2017. p. 1–5."/> <meta name="citation_reference" content="Commission Nationale de l’Informatique et des Libertés. https://www.cnil.fr/en/home "/> <meta name="citation_reference" content="Team TPD. pandas-dev/pandas: Pandas 1.3.2; 2021. Available from: https://doi.org/10.5281/zenodo.5203279 ."/> <meta name="citation_reference" content="Wes McKinney. Data Structures for Statistical Computing in Python. In: Stéfan van der Walt, Jarrod Millman, editors. Proceedings of the 9th Python in Science Conference; 2010. p. 56 – 61."/> <meta name="citation_reference" content="citation_title=Scikit-learn: Machine Learning in Python;citation_author=F Pedregosa;citation_author=G Varoquaux;citation_author=A Gramfort;citation_author=V Michel;citation_author=B Thirion;citation_author=O Grisel;citation_journal_title=Journal of Machine Learning Research;citation_volume=12;citation_number=12;citation_first_page=2825;citation_last_page=2830;citation_publication_date=2011;"/> <meta name="citation_reference" content="citation_title=Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning;citation_author=G Lemaître;citation_author=F Nogueira;citation_author=CK Aridas;citation_journal_title=Journal of Machine Learning Research;citation_volume=18;citation_number=18;citation_issue=17;citation_first_page=1;citation_last_page=5;citation_publication_date=2017;"/>  <script type='text/javascript'> var googletag = googletag || {}; googletag.cmd = googletag.cmd || []; (function() { var gads = document.createElement('script'); gads.async = true; gads.type = 'text/javascript'; var useSSL = 'https:' == document.location.protocol; gads.src = (useSSL ? 'https:' : 'http:') + '//www.googletagservices.com/tag/js/gpt.js'; var node = document.getElementsByTagName('script')[0]; node.parentNode.insertBefore(gads, node); })(); </script>  <script id="doubleClickSetupScript" type='text/javascript'> googletag.cmd.push(function() { googletag.defineSlot('/75507958/PONE_728x90_ATF', [728, 90], 'div-gpt-ad-1458247671871-0').addService(googletag.pubads()); googletag.defineSlot('/75507958/PONE_160x600_BTF', [160, 600], 'div-gpt-ad-1458247671871-1').addService(googletag.pubads()); var personalizedAds = window.plosCookieConsent && window.plosCookieConsent.hasConsented('advertising'); googletag.pubads().setRequestNonPersonalizedAds(personalizedAds ? 0 : 1); googletag.pubads().enableSingleRequest(); googletag.enableServices(); }); </script> <script type="text/javascript"> var WombatConfig = WombatConfig || {}; WombatConfig.journalKey = "PLoSONE"; WombatConfig.journalName = "PLOS ONE"; WombatConfig.figurePath = "/plosone/article/figure/image"; WombatConfig.figShareInstitutionString = "plos"; WombatConfig.doiResolverPrefix = "https://dx.plos.org/"; </script> <script type="text/javascript"> var WombatConfig = WombatConfig || {}; WombatConfig.metrics = WombatConfig.metrics || {}; WombatConfig.metrics.referenceUrl = "http://lagotto.io/plos"; WombatConfig.metrics.googleScholarUrl = "https://scholar.google.com/scholar"; WombatConfig.metrics.googleScholarCitationUrl = WombatConfig.metrics.googleScholarUrl + "?hl=en&lr=&q="; WombatConfig.metrics.crossrefUrl = "https://www.crossref.org"; </script> <script defer="defer" src="/resource/js/defer.js?5d23b84e5e396356b27c"></script><script src="/resource/js/sync.js?5d23b84e5e396356b27c"></script> <script src="/resource/js/vendor/jquery.min.js" type="text/javascript"></script> <script type="text/javascript" src="https://widgets.figshare.com/static/figshare.js"></script> <script src="/resource/js/vendor/fastclick/lib/fastclick.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.js" type="text/javascript"></script> <script src="/resource/js/vendor/underscore-min.js" type="text/javascript"></script> <script src="/resource/js/vendor/underscore.string.min.js" type="text/javascript"></script> <script src="/resource/js/vendor/moment.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery-ui-effects.min.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.tooltip.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.dropdown.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.tab.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.reveal.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.slider.js" type="text/javascript"></script> <script src="/resource/js/util/utils.js" type="text/javascript"></script> <script src="/resource/js/components/toggle.js" type="text/javascript"></script> <script src="/resource/js/components/truncate_elem.js" type="text/javascript"></script> <script src="/resource/js/components/tooltip_hover.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.dotdotdot.js" type="text/javascript"></script>  <script> dataLayer = [{ 'mobileSite': 'false', 'desktopSite': 'true' }]; </script> <title>Prediction of hospital readmission of multimorbid patients using machine learning models | PLOS ONE</title> </head> <body class="article plosone">  <noscript><iframe src="//www.googletagmanager.com/ns.html?id=GTM-TP26BH" height="0" width="0" style="display:none;visibility:hidden"></iframe></noscript> <script> (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start': new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0], j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src= '//www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f); })(window,document,'script','dataLayer','GTM-TP26BH'); </script> <noscript><iframe src="//www.googletagmanager.com/ns.html?id=GTM-MQQMGF" height="0" width="0" style="display:none;visibility:hidden"></iframe></noscript> <script>(function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start': new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0], j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src= '//www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f); })(window,document,'script','dataLayer','GTM-MQQMGF');</script>   <script> // from https://developers.hubspot.com/docs/reference/api/analytics-and-events/cookie-banner/cookie-banner-api#example-using-a-third-party-cookie-banner-to-control-hubspot-cookies window.disableHubSpotCookieBanner = true; window._hsp = window._hsp || []; window._hsp.push(['setHubSpotConsent', { analytics: window.plosCookieConsent?.hasConsented('analytics'), advertisement: window.plosCookieConsent?.hasConsented('advertising'), functionality: window.plosCookieConsent?.hasConsented('functionality') } ]); </script> <script type="text/javascript" id="hs-script-loader" async defer src="//js.hs-scripts.com/44092021.js"></script>   <script type="text/javascript"> ;window.NREUM||(NREUM={});NREUM.init={distributed_tracing:{enabled:true},privacy:{cookies_enabled:true},ajax:{deny_list:["bam.nr-data.net"]}}; window.NREUM||(NREUM={}),__nr_require=function(t,e,n){function r(n){if(!e[n]){var o=e[n]={exports:{}};t[n][0].call(o.exports,function(e){var o=t[n][1][e];return r(o||e)},o,o.exports)}return e[n].exports}if("function"==typeof __nr_require)return __nr_require;for(var o=0;o<n.length;o++)r(n[o]);return r}({1:[function(t,e,n){function r(t){try{s.console&&console.log(t)}catch(e){}}var o,i=t("ee"),a=t(32),s={};try{o=localStorage.getItem("__nr_flags").split(","),console&&"function"==typeof console.log&&(s.console=!0,o.indexOf("dev")!==-1&&(s.dev=!0),o.indexOf("nr_dev")!==-1&&(s.nrDev=!0))}catch(c){}s.nrDev&&i.on("internal-error",function(t){r(t.stack)}),s.dev&&i.on("fn-err",function(t,e,n){r(n.stack)}),s.dev&&(r("NR AGENT IN DEVELOPMENT MODE"),r("flags: "+a(s,function(t,e){return t}).join(", ")))},{}],2:[function(t,e,n){function r(t,e,n,r,s){try{l?l-=1:o(s||new UncaughtException(t,e,n),!0)}catch(f){try{i("ierr",[f,c.now(),!0])}catch(d){}}return"function"==typeof u&&u.apply(this,a(arguments))}function UncaughtException(t,e,n){this.message=t||"Uncaught error with no additional information",this.sourceURL=e,this.line=n}function o(t,e){var n=e?null:c.now();i("err",[t,n])}var i=t("handle"),a=t(33),s=t("ee"),c=t("loader"),f=t("gos"),u=window.onerror,d=!1,p="nr@seenError";if(!c.disabled){var l=0;c.features.err=!0,t(1),window.onerror=r;try{throw new Error}catch(h){"stack"in h&&(t(14),t(13),"addEventListener"in window&&t(7),c.xhrWrappable&&t(15),d=!0)}s.on("fn-start",function(t,e,n){d&&(l+=1)}),s.on("fn-err",function(t,e,n){d&&!n[p]&&(f(n,p,function(){return!0}),this.thrown=!0,o(n))}),s.on("fn-end",function(){d&&!this.thrown&&l>0&&(l-=1)}),s.on("internal-error",function(t){i("ierr",[t,c.now(),!0])})}},{}],3:[function(t,e,n){var r=t("loader");r.disabled||(r.features.ins=!0)},{}],4:[function(t,e,n){function r(){U++,L=g.hash,this[u]=y.now()}function o(){U--,g.hash!==L&&i(0,!0);var t=y.now();this[h]=~~this[h]+t-this[u],this[d]=t}function i(t,e){E.emit("newURL",[""+g,e])}function a(t,e){t.on(e,function(){this[e]=y.now()})}var s="-start",c="-end",f="-body",u="fn"+s,d="fn"+c,p="cb"+s,l="cb"+c,h="jsTime",m="fetch",v="addEventListener",w=window,g=w.location,y=t("loader");if(w[v]&&y.xhrWrappable&&!y.disabled){var x=t(11),b=t(12),E=t(9),R=t(7),O=t(14),T=t(8),P=t(15),S=t(10),M=t("ee"),N=M.get("tracer"),C=t(23);t(17),y.features.spa=!0;var L,U=0;M.on(u,r),b.on(p,r),S.on(p,r),M.on(d,o),b.on(l,o),S.on(l,o),M.buffer([u,d,"xhr-resolved"]),R.buffer([u]),O.buffer(["setTimeout"+c,"clearTimeout"+s,u]),P.buffer([u,"new-xhr","send-xhr"+s]),T.buffer([m+s,m+"-done",m+f+s,m+f+c]),E.buffer(["newURL"]),x.buffer([u]),b.buffer(["propagate",p,l,"executor-err","resolve"+s]),N.buffer([u,"no-"+u]),S.buffer(["new-jsonp","cb-start","jsonp-error","jsonp-end"]),a(T,m+s),a(T,m+"-done"),a(S,"new-jsonp"),a(S,"jsonp-end"),a(S,"cb-start"),E.on("pushState-end",i),E.on("replaceState-end",i),w[v]("hashchange",i,C(!0)),w[v]("load",i,C(!0)),w[v]("popstate",function(){i(0,U>1)},C(!0))}},{}],5:[function(t,e,n){function r(){var t=new PerformanceObserver(function(t,e){var n=t.getEntries();s(v,[n])});try{t.observe({entryTypes:["resource"]})}catch(e){}}function o(t){if(s(v,[window.performance.getEntriesByType(w)]),window.performance["c"+p])try{window.performance[h](m,o,!1)}catch(t){}else try{window.performance[h]("webkit"+m,o,!1)}catch(t){}}function i(t){}if(window.performance&&window.performance.timing&&window.performance.getEntriesByType){var a=t("ee"),s=t("handle"),c=t(14),f=t(13),u=t(6),d=t(23),p="learResourceTimings",l="addEventListener",h="removeEventListener",m="resourcetimingbufferfull",v="bstResource",w="resource",g="-start",y="-end",x="fn"+g,b="fn"+y,E="bstTimer",R="pushState",O=t("loader");if(!O.disabled){O.features.stn=!0,t(9),"addEventListener"in window&&t(7);var T=NREUM.o.EV;a.on(x,function(t,e){var n=t[0];n instanceof T&&(this.bstStart=O.now())}),a.on(b,function(t,e){var n=t[0];n instanceof T&&s("bst",[n,e,this.bstStart,O.now()])}),c.on(x,function(t,e,n){this.bstStart=O.now(),this.bstType=n}),c.on(b,function(t,e){s(E,[e,this.bstStart,O.now(),this.bstType])}),f.on(x,function(){this.bstStart=O.now()}),f.on(b,function(t,e){s(E,[e,this.bstStart,O.now(),"requestAnimationFrame"])}),a.on(R+g,function(t){this.time=O.now(),this.startPath=location.pathname+location.hash}),a.on(R+y,function(t){s("bstHist",[location.pathname+location.hash,this.startPath,this.time])}),u()?(s(v,[window.performance.getEntriesByType("resource")]),r()):l in window.performance&&(window.performance["c"+p]?window.performance[l](m,o,d(!1)):window.performance[l]("webkit"+m,o,d(!1))),document[l]("scroll",i,d(!1)),document[l]("keypress",i,d(!1)),document[l]("click",i,d(!1))}}},{}],6:[function(t,e,n){e.exports=function(){return"PerformanceObserver"in window&&"function"==typeof window.PerformanceObserver}},{}],7:[function(t,e,n){function r(t){for(var e=t;e&&!e.hasOwnProperty(u);)e=Object.getPrototypeOf(e);e&&o(e)}function o(t){s.inPlace(t,[u,d],"-",i)}function i(t,e){return t[1]}var a=t("ee").get("events"),s=t("wrap-function")(a,!0),c=t("gos"),f=XMLHttpRequest,u="addEventListener",d="removeEventListener";e.exports=a,"getPrototypeOf"in Object?(r(document),r(window),r(f.prototype)):f.prototype.hasOwnProperty(u)&&(o(window),o(f.prototype)),a.on(u+"-start",function(t,e){var n=t[1];if(null!==n&&("function"==typeof n||"object"==typeof n)){var r=c(n,"nr@wrapped",function(){function t(){if("function"==typeof n.handleEvent)return n.handleEvent.apply(n,arguments)}var e={object:t,"function":n}[typeof n];return e?s(e,"fn-",null,e.name||"anonymous"):n});this.wrapped=t[1]=r}}),a.on(d+"-start",function(t){t[1]=this.wrapped||t[1]})},{}],8:[function(t,e,n){function r(t,e,n){var r=t[e];"function"==typeof r&&(t[e]=function(){var t=i(arguments),e={};o.emit(n+"before-start",[t],e);var a;e[m]&&e[m].dt&&(a=e[m].dt);var s=r.apply(this,t);return o.emit(n+"start",[t,a],s),s.then(function(t){return o.emit(n+"end",[null,t],s),t},function(t){throw o.emit(n+"end",[t],s),t})})}var o=t("ee").get("fetch"),i=t(33),a=t(32);e.exports=o;var s=window,c="fetch-",f=c+"body-",u=["arrayBuffer","blob","json","text","formData"],d=s.Request,p=s.Response,l=s.fetch,h="prototype",m="nr@context";d&&p&&l&&(a(u,function(t,e){r(d[h],e,f),r(p[h],e,f)}),r(s,"fetch",c),o.on(c+"end",function(t,e){var n=this;if(e){var r=e.headers.get("content-length");null!==r&&(n.rxSize=r),o.emit(c+"done",[null,e],n)}else o.emit(c+"done",[t],n)}))},{}],9:[function(t,e,n){var r=t("ee").get("history"),o=t("wrap-function")(r);e.exports=r;var i=window.history&&window.history.constructor&&window.history.constructor.prototype,a=window.history;i&&i.pushState&&i.replaceState&&(a=i),o.inPlace(a,["pushState","replaceState"],"-")},{}],10:[function(t,e,n){function r(t){function e(){f.emit("jsonp-end",[],l),t.removeEventListener("load",e,c(!1)),t.removeEventListener("error",n,c(!1))}function n(){f.emit("jsonp-error",[],l),f.emit("jsonp-end",[],l),t.removeEventListener("load",e,c(!1)),t.removeEventListener("error",n,c(!1))}var r=t&&"string"==typeof t.nodeName&&"script"===t.nodeName.toLowerCase();if(r){var o="function"==typeof t.addEventListener;if(o){var a=i(t.src);if(a){var d=s(a),p="function"==typeof d.parent[d.key];if(p){var l={};u.inPlace(d.parent,[d.key],"cb-",l),t.addEventListener("load",e,c(!1)),t.addEventListener("error",n,c(!1)),f.emit("new-jsonp",[t.src],l)}}}}}function o(){return"addEventListener"in window}function i(t){var e=t.match(d);return e?e[1]:null}function a(t,e){var n=t.match(l),r=n[1],o=n[3];return o?a(o,e[r]):e[r]}function s(t){var e=t.match(p);return e&&e.length>=3?{key:e[2],parent:a(e[1],window)}:{key:t,parent:window}}var c=t(23),f=t("ee").get("jsonp"),u=t("wrap-function")(f);if(e.exports=f,o()){var d=/[?&](?:callback|cb)=([^&#]+)/,p=/(.*)\.([^.]+)/,l=/^(\w+)(\.|$)(.*)$/,h=["appendChild","insertBefore","replaceChild"];Node&&Node.prototype&&Node.prototype.appendChild?u.inPlace(Node.prototype,h,"dom-"):(u.inPlace(HTMLElement.prototype,h,"dom-"),u.inPlace(HTMLHeadElement.prototype,h,"dom-"),u.inPlace(HTMLBodyElement.prototype,h,"dom-")),f.on("dom-start",function(t){r(t[0])})}},{}],11:[function(t,e,n){var r=t("ee").get("mutation"),o=t("wrap-function")(r),i=NREUM.o.MO;e.exports=r,i&&(window.MutationObserver=function(t){return this instanceof i?new i(o(t,"fn-")):i.apply(this,arguments)},MutationObserver.prototype=i.prototype)},{}],12:[function(t,e,n){function r(t){var e=i.context(),n=s(t,"executor-",e,null,!1),r=new f(n);return i.context(r).getCtx=function(){return e},r}var o=t("wrap-function"),i=t("ee").get("promise"),a=t("ee").getOrSetContext,s=o(i),c=t(32),f=NREUM.o.PR;e.exports=i,f&&(window.Promise=r,["all","race"].forEach(function(t){var e=f[t];f[t]=function(n){function r(t){return function(){i.emit("propagate",[null,!o],a,!1,!1),o=o||!t}}var o=!1;c(n,function(e,n){Promise.resolve(n).then(r("all"===t),r(!1))});var a=e.apply(f,arguments),s=f.resolve(a);return s}}),["resolve","reject"].forEach(function(t){var e=f[t];f[t]=function(t){var n=e.apply(f,arguments);return t!==n&&i.emit("propagate",[t,!0],n,!1,!1),n}}),f.prototype["catch"]=function(t){return this.then(null,t)},f.prototype=Object.create(f.prototype,{constructor:{value:r}}),c(Object.getOwnPropertyNames(f),function(t,e){try{r[e]=f[e]}catch(n){}}),o.wrapInPlace(f.prototype,"then",function(t){return function(){var e=this,n=o.argsToArray.apply(this,arguments),r=a(e);r.promise=e,n[0]=s(n[0],"cb-",r,null,!1),n[1]=s(n[1],"cb-",r,null,!1);var c=t.apply(this,n);return r.nextPromise=c,i.emit("propagate",[e,!0],c,!1,!1),c}}),i.on("executor-start",function(t){t[0]=s(t[0],"resolve-",this,null,!1),t[1]=s(t[1],"resolve-",this,null,!1)}),i.on("executor-err",function(t,e,n){t[1](n)}),i.on("cb-end",function(t,e,n){i.emit("propagate",[n,!0],this.nextPromise,!1,!1)}),i.on("propagate",function(t,e,n){this.getCtx&&!e||(this.getCtx=function(){if(t instanceof Promise)var e=i.context(t);return e&&e.getCtx?e.getCtx():this})}),r.toString=function(){return""+f})},{}],13:[function(t,e,n){var r=t("ee").get("raf"),o=t("wrap-function")(r),i="equestAnimationFrame";e.exports=r,o.inPlace(window,["r"+i,"mozR"+i,"webkitR"+i,"msR"+i],"raf-"),r.on("raf-start",function(t){t[0]=o(t[0],"fn-")})},{}],14:[function(t,e,n){function r(t,e,n){t[0]=a(t[0],"fn-",null,n)}function o(t,e,n){this.method=n,this.timerDuration=isNaN(t[1])?0:+t[1],t[0]=a(t[0],"fn-",this,n)}var i=t("ee").get("timer"),a=t("wrap-function")(i),s="setTimeout",c="setInterval",f="clearTimeout",u="-start",d="-";e.exports=i,a.inPlace(window,[s,"setImmediate"],s+d),a.inPlace(window,[c],c+d),a.inPlace(window,[f,"clearImmediate"],f+d),i.on(c+u,r),i.on(s+u,o)},{}],15:[function(t,e,n){function r(t,e){d.inPlace(e,["onreadystatechange"],"fn-",s)}function o(){var t=this,e=u.context(t);t.readyState>3&&!e.resolved&&(e.resolved=!0,u.emit("xhr-resolved",[],t)),d.inPlace(t,y,"fn-",s)}function i(t){x.push(t),m&&(E?E.then(a):w?w(a):(R=-R,O.data=R))}function a(){for(var t=0;t<x.length;t++)r([],x[t]);x.length&&(x=[])}function s(t,e){return e}function c(t,e){for(var n in t)e[n]=t[n];return e}t(7);var f=t("ee"),u=f.get("xhr"),d=t("wrap-function")(u),p=t(23),l=NREUM.o,h=l.XHR,m=l.MO,v=l.PR,w=l.SI,g="readystatechange",y=["onload","onerror","onabort","onloadstart","onloadend","onprogress","ontimeout"],x=[];e.exports=u;var b=window.XMLHttpRequest=function(t){var e=new h(t);try{u.emit("new-xhr",[e],e),e.addEventListener(g,o,p(!1))}catch(n){try{u.emit("internal-error",[n])}catch(r){}}return e};if(c(h,b),b.prototype=h.prototype,d.inPlace(b.prototype,["open","send"],"-xhr-",s),u.on("send-xhr-start",function(t,e){r(t,e),i(e)}),u.on("open-xhr-start",r),m){var E=v&&v.resolve();if(!w&&!v){var R=1,O=document.createTextNode(R);new m(a).observe(O,{characterData:!0})}}else f.on("fn-end",function(t){t[0]&&t[0].type===g||a()})},{}],16:[function(t,e,n){function r(t){if(!s(t))return null;var e=window.NREUM;if(!e.loader_config)return null;var n=(e.loader_config.accountID||"").toString()||null,r=(e.loader_config.agentID||"").toString()||null,f=(e.loader_config.trustKey||"").toString()||null;if(!n||!r)return null;var h=l.generateSpanId(),m=l.generateTraceId(),v=Date.now(),w={spanId:h,traceId:m,timestamp:v};return(t.sameOrigin||c(t)&&p())&&(w.traceContextParentHeader=o(h,m),w.traceContextStateHeader=i(h,v,n,r,f)),(t.sameOrigin&&!u()||!t.sameOrigin&&c(t)&&d())&&(w.newrelicHeader=a(h,m,v,n,r,f)),w}function o(t,e){return"00-"+e+"-"+t+"-01"}function i(t,e,n,r,o){var i=0,a="",s=1,c="",f="";return o+"@nr="+i+"-"+s+"-"+n+"-"+r+"-"+t+"-"+a+"-"+c+"-"+f+"-"+e}function a(t,e,n,r,o,i){var a="btoa"in window&&"function"==typeof window.btoa;if(!a)return null;var s={v:[0,1],d:{ty:"Browser",ac:r,ap:o,id:t,tr:e,ti:n}};return i&&r!==i&&(s.d.tk=i),btoa(JSON.stringify(s))}function s(t){return f()&&c(t)}function c(t){var e=!1,n={};if("init"in NREUM&&"distributed_tracing"in NREUM.init&&(n=NREUM.init.distributed_tracing),t.sameOrigin)e=!0;else if(n.allowed_origins instanceof Array)for(var r=0;r<n.allowed_origins.length;r++){var o=h(n.allowed_origins[r]);if(t.hostname===o.hostname&&t.protocol===o.protocol&&t.port===o.port){e=!0;break}}return e}function f(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&!!NREUM.init.distributed_tracing.enabled}function u(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&!!NREUM.init.distributed_tracing.exclude_newrelic_header}function d(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&NREUM.init.distributed_tracing.cors_use_newrelic_header!==!1}function p(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&!!NREUM.init.distributed_tracing.cors_use_tracecontext_headers}var l=t(29),h=t(18);e.exports={generateTracePayload:r,shouldGenerateTrace:s}},{}],17:[function(t,e,n){function r(t){var e=this.params,n=this.metrics;if(!this.ended){this.ended=!0;for(var r=0;r<p;r++)t.removeEventListener(d[r],this.listener,!1);e.aborted||(n.duration=a.now()-this.startTime,this.loadCaptureCalled||4!==t.readyState?null==e.status&&(e.status=0):i(this,t),n.cbTime=this.cbTime,s("xhr",[e,n,this.startTime,this.endTime,"xhr"],this))}}function o(t,e){var n=c(e),r=t.params;r.hostname=n.hostname,r.port=n.port,r.protocol=n.protocol,r.host=n.hostname+":"+n.port,r.pathname=n.pathname,t.parsedOrigin=n,t.sameOrigin=n.sameOrigin}function i(t,e){t.params.status=e.status;var n=v(e,t.lastSize);if(n&&(t.metrics.rxSize=n),t.sameOrigin){var r=e.getResponseHeader("X-NewRelic-App-Data");r&&(t.params.cat=r.split(", ").pop())}t.loadCaptureCalled=!0}var a=t("loader");if(a.xhrWrappable&&!a.disabled){var s=t("handle"),c=t(18),f=t(16).generateTracePayload,u=t("ee"),d=["load","error","abort","timeout"],p=d.length,l=t("id"),h=t(24),m=t(22),v=t(19),w=t(23),g=NREUM.o.REQ,y=window.XMLHttpRequest;a.features.xhr=!0,t(15),t(8),u.on("new-xhr",function(t){var e=this;e.totalCbs=0,e.called=0,e.cbTime=0,e.end=r,e.ended=!1,e.xhrGuids={},e.lastSize=null,e.loadCaptureCalled=!1,e.params=this.params||{},e.metrics=this.metrics||{},t.addEventListener("load",function(n){i(e,t)},w(!1)),h&&(h>34||h<10)||t.addEventListener("progress",function(t){e.lastSize=t.loaded},w(!1))}),u.on("open-xhr-start",function(t){this.params={method:t[0]},o(this,t[1]),this.metrics={}}),u.on("open-xhr-end",function(t,e){"loader_config"in NREUM&&"xpid"in NREUM.loader_config&&this.sameOrigin&&e.setRequestHeader("X-NewRelic-ID",NREUM.loader_config.xpid);var n=f(this.parsedOrigin);if(n){var r=!1;n.newrelicHeader&&(e.setRequestHeader("newrelic",n.newrelicHeader),r=!0),n.traceContextParentHeader&&(e.setRequestHeader("traceparent",n.traceContextParentHeader),n.traceContextStateHeader&&e.setRequestHeader("tracestate",n.traceContextStateHeader),r=!0),r&&(this.dt=n)}}),u.on("send-xhr-start",function(t,e){var n=this.metrics,r=t[0],o=this;if(n&&r){var i=m(r);i&&(n.txSize=i)}this.startTime=a.now(),this.listener=function(t){try{"abort"!==t.type||o.loadCaptureCalled||(o.params.aborted=!0),("load"!==t.type||o.called===o.totalCbs&&(o.onloadCalled||"function"!=typeof e.onload))&&o.end(e)}catch(n){try{u.emit("internal-error",[n])}catch(r){}}};for(var s=0;s<p;s++)e.addEventListener(d[s],this.listener,w(!1))}),u.on("xhr-cb-time",function(t,e,n){this.cbTime+=t,e?this.onloadCalled=!0:this.called+=1,this.called!==this.totalCbs||!this.onloadCalled&&"function"==typeof n.onload||this.end(n)}),u.on("xhr-load-added",function(t,e){var n=""+l(t)+!!e;this.xhrGuids&&!this.xhrGuids[n]&&(this.xhrGuids[n]=!0,this.totalCbs+=1)}),u.on("xhr-load-removed",function(t,e){var n=""+l(t)+!!e;this.xhrGuids&&this.xhrGuids[n]&&(delete this.xhrGuids[n],this.totalCbs-=1)}),u.on("xhr-resolved",function(){this.endTime=a.now()}),u.on("addEventListener-end",function(t,e){e instanceof y&&"load"===t[0]&&u.emit("xhr-load-added",[t[1],t[2]],e)}),u.on("removeEventListener-end",function(t,e){e instanceof y&&"load"===t[0]&&u.emit("xhr-load-removed",[t[1],t[2]],e)}),u.on("fn-start",function(t,e,n){e instanceof y&&("onload"===n&&(this.onload=!0),("load"===(t[0]&&t[0].type)||this.onload)&&(this.xhrCbStart=a.now()))}),u.on("fn-end",function(t,e){this.xhrCbStart&&u.emit("xhr-cb-time",[a.now()-this.xhrCbStart,this.onload,e],e)}),u.on("fetch-before-start",function(t){function e(t,e){var n=!1;return e.newrelicHeader&&(t.set("newrelic",e.newrelicHeader),n=!0),e.traceContextParentHeader&&(t.set("traceparent",e.traceContextParentHeader),e.traceContextStateHeader&&t.set("tracestate",e.traceContextStateHeader),n=!0),n}var n,r=t[1]||{};"string"==typeof t[0]?n=t[0]:t[0]&&t[0].url?n=t[0].url:window.URL&&t[0]&&t[0]instanceof URL&&(n=t[0].href),n&&(this.parsedOrigin=c(n),this.sameOrigin=this.parsedOrigin.sameOrigin);var o=f(this.parsedOrigin);if(o&&(o.newrelicHeader||o.traceContextParentHeader))if("string"==typeof t[0]||window.URL&&t[0]&&t[0]instanceof URL){var i={};for(var a in r)i[a]=r[a];i.headers=new Headers(r.headers||{}),e(i.headers,o)&&(this.dt=o),t.length>1?t[1]=i:t.push(i)}else t[0]&&t[0].headers&&e(t[0].headers,o)&&(this.dt=o)}),u.on("fetch-start",function(t,e){this.params={},this.metrics={},this.startTime=a.now(),this.dt=e,t.length>=1&&(this.target=t[0]),t.length>=2&&(this.opts=t[1]);var n,r=this.opts||{},i=this.target;"string"==typeof i?n=i:"object"==typeof i&&i instanceof g?n=i.url:window.URL&&"object"==typeof i&&i instanceof URL&&(n=i.href),o(this,n);var s=(""+(i&&i instanceof g&&i.method||r.method||"GET")).toUpperCase();this.params.method=s,this.txSize=m(r.body)||0}),u.on("fetch-done",function(t,e){this.endTime=a.now(),this.params||(this.params={}),this.params.status=e?e.status:0;var n;"string"==typeof this.rxSize&&this.rxSize.length>0&&(n=+this.rxSize);var r={txSize:this.txSize,rxSize:n,duration:a.now()-this.startTime};s("xhr",[this.params,r,this.startTime,this.endTime,"fetch"],this)})}},{}],18:[function(t,e,n){var r={};e.exports=function(t){if(t in r)return r[t];var e=document.createElement("a"),n=window.location,o={};e.href=t,o.port=e.port;var i=e.href.split("://");!o.port&&i[1]&&(o.port=i[1].split("/")[0].split("@").pop().split(":")[1]),o.port&&"0"!==o.port||(o.port="https"===i[0]?"443":"80"),o.hostname=e.hostname||n.hostname,o.pathname=e.pathname,o.protocol=i[0],"/"!==o.pathname.charAt(0)&&(o.pathname="/"+o.pathname);var a=!e.protocol||":"===e.protocol||e.protocol===n.protocol,s=e.hostname===document.domain&&e.port===n.port;return o.sameOrigin=a&&(!e.hostname||s),"/"===o.pathname&&(r[t]=o),o}},{}],19:[function(t,e,n){function r(t,e){var n=t.responseType;return"json"===n&&null!==e?e:"arraybuffer"===n||"blob"===n||"json"===n?o(t.response):"text"===n||""===n||void 0===n?o(t.responseText):void 0}var o=t(22);e.exports=r},{}],20:[function(t,e,n){function r(){}function o(t,e,n,r){return function(){return u.recordSupportability("API/"+e+"/called"),i(t+e,[f.now()].concat(s(arguments)),n?null:this,r),n?void 0:this}}var i=t("handle"),a=t(32),s=t(33),c=t("ee").get("tracer"),f=t("loader"),u=t(25),d=NREUM;"undefined"==typeof window.newrelic&&(newrelic=d);var p=["setPageViewName","setCustomAttribute","setErrorHandler","finished","addToTrace","inlineHit","addRelease"],l="api-",h=l+"ixn-";a(p,function(t,e){d[e]=o(l,e,!0,"api")}),d.addPageAction=o(l,"addPageAction",!0),d.setCurrentRouteName=o(l,"routeName",!0),e.exports=newrelic,d.interaction=function(){return(new r).get()};var m=r.prototype={createTracer:function(t,e){var n={},r=this,o="function"==typeof e;return i(h+"tracer",[f.now(),t,n],r),function(){if(c.emit((o?"":"no-")+"fn-start",[f.now(),r,o],n),o)try{return e.apply(this,arguments)}catch(t){throw c.emit("fn-err",[arguments,this,t],n),t}finally{c.emit("fn-end",[f.now()],n)}}}};a("actionText,setName,setAttribute,save,ignore,onEnd,getContext,end,get".split(","),function(t,e){m[e]=o(h,e)}),newrelic.noticeError=function(t,e){"string"==typeof t&&(t=new Error(t)),u.recordSupportability("API/noticeError/called"),i("err",[t,f.now(),!1,e])}},{}],21:[function(t,e,n){function r(t){if(NREUM.init){for(var e=NREUM.init,n=t.split("."),r=0;r<n.length-1;r++)if(e=e[n[r]],"object"!=typeof e)return;return e=e[n[n.length-1]]}}e.exports={getConfiguration:r}},{}],22:[function(t,e,n){e.exports=function(t){if("string"==typeof t&&t.length)return t.length;if("object"==typeof t){if("undefined"!=typeof ArrayBuffer&&t instanceof ArrayBuffer&&t.byteLength)return t.byteLength;if("undefined"!=typeof Blob&&t instanceof Blob&&t.size)return t.size;if(!("undefined"!=typeof FormData&&t instanceof FormData))try{return JSON.stringify(t).length}catch(e){return}}}},{}],23:[function(t,e,n){var r=!1;try{var o=Object.defineProperty({},"passive",{get:function(){r=!0}});window.addEventListener("testPassive",null,o),window.removeEventListener("testPassive",null,o)}catch(i){}e.exports=function(t){return r?{passive:!0,capture:!!t}:!!t}},{}],24:[function(t,e,n){var r=0,o=navigator.userAgent.match(/Firefox[\/\s](\d+\.\d+)/);o&&(r=+o[1]),e.exports=r},{}],25:[function(t,e,n){function r(t,e){var n=[a,t,{name:t},e];return i("storeMetric",n,null,"api"),n}function o(t,e){var n=[s,t,{name:t},e];return i("storeEventMetrics",n,null,"api"),n}var i=t("handle"),a="sm",s="cm";e.exports={constants:{SUPPORTABILITY_METRIC:a,CUSTOM_METRIC:s},recordSupportability:r,recordCustom:o}},{}],26:[function(t,e,n){function r(){return s.exists&&performance.now?Math.round(performance.now()):(i=Math.max((new Date).getTime(),i))-a}function o(){return i}var i=(new Date).getTime(),a=i,s=t(34);e.exports=r,e.exports.offset=a,e.exports.getLastTimestamp=o},{}],27:[function(t,e,n){function r(t){return!(!t||!t.protocol||"file:"===t.protocol)}e.exports=r},{}],28:[function(t,e,n){function r(t,e){var n=t.getEntries();n.forEach(function(t){"first-paint"===t.name?p("timing",["fp",Math.floor(t.startTime)]):"first-contentful-paint"===t.name&&p("timing",["fcp",Math.floor(t.startTime)])})}function o(t,e){var n=t.getEntries();if(n.length>0){var r=n[n.length-1];if(c&&c<r.startTime)return;p("lcp",[r])}}function i(t){t.getEntries().forEach(function(t){t.hadRecentInput||p("cls",[t])})}function a(t){if(t instanceof v&&!g){var e=Math.round(t.timeStamp),n={type:t.type};e<=l.now()?n.fid=l.now()-e:e>l.offset&&e<=Date.now()?(e-=l.offset,n.fid=l.now()-e):e=l.now(),g=!0,p("timing",["fi",e,n])}}function s(t){"hidden"===t&&(c=l.now(),p("pageHide",[c]))}if(!("init"in NREUM&&"page_view_timing"in NREUM.init&&"enabled"in NREUM.init.page_view_timing&&NREUM.init.page_view_timing.enabled===!1)){var c,f,u,d,p=t("handle"),l=t("loader"),h=t(31),m=t(23),v=NREUM.o.EV;if("PerformanceObserver"in window&&"function"==typeof window.PerformanceObserver){f=new PerformanceObserver(r);try{f.observe({entryTypes:["paint"]})}catch(w){}u=new PerformanceObserver(o);try{u.observe({entryTypes:["largest-contentful-paint"]})}catch(w){}d=new PerformanceObserver(i);try{d.observe({type:"layout-shift",buffered:!0})}catch(w){}}if("addEventListener"in document){var g=!1,y=["click","keydown","mousedown","pointerdown","touchstart"];y.forEach(function(t){document.addEventListener(t,a,m(!1))})}h(s)}},{}],29:[function(t,e,n){function r(){function t(){return e?15&e[n++]:16*Math.random()|0}var e=null,n=0,r=window.crypto||window.msCrypto;r&&r.getRandomValues&&(e=r.getRandomValues(new Uint8Array(31)));for(var o,i="xxxxxxxx-xxxx-4xxx-yxxx-xxxxxxxxxxxx",a="",s=0;s<i.length;s++)o=i[s],"x"===o?a+=t().toString(16):"y"===o?(o=3&t()|8,a+=o.toString(16)):a+=o;return a}function o(){return a(16)}function i(){return a(32)}function a(t){function e(){return n?15&n[r++]:16*Math.random()|0}var n=null,r=0,o=window.crypto||window.msCrypto;o&&o.getRandomValues&&Uint8Array&&(n=o.getRandomValues(new Uint8Array(31)));for(var i=[],a=0;a<t;a++)i.push(e().toString(16));return i.join("")}e.exports={generateUuid:r,generateSpanId:o,generateTraceId:i}},{}],30:[function(t,e,n){function r(t,e){if(!o)return!1;if(t!==o)return!1;if(!e)return!0;if(!i)return!1;for(var n=i.split("."),r=e.split("."),a=0;a<r.length;a++)if(r[a]!==n[a])return!1;return!0}var o=null,i=null,a=/Version\/(\S+)\s+Safari/;if(navigator.userAgent){var s=navigator.userAgent,c=s.match(a);c&&s.indexOf("Chrome")===-1&&s.indexOf("Chromium")===-1&&(o="Safari",i=c[1])}e.exports={agent:o,version:i,match:r}},{}],31:[function(t,e,n){function r(t){function e(){t(s&&document[s]?document[s]:document[i]?"hidden":"visible")}"addEventListener"in document&&a&&document.addEventListener(a,e,o(!1))}var o=t(23);e.exports=r;var i,a,s;"undefined"!=typeof document.hidden?(i="hidden",a="visibilitychange",s="visibilityState"):"undefined"!=typeof document.msHidden?(i="msHidden",a="msvisibilitychange"):"undefined"!=typeof document.webkitHidden&&(i="webkitHidden",a="webkitvisibilitychange",s="webkitVisibilityState")},{}],32:[function(t,e,n){function r(t,e){var n=[],r="",i=0;for(r in t)o.call(t,r)&&(n[i]=e(r,t[r]),i+=1);return n}var o=Object.prototype.hasOwnProperty;e.exports=r},{}],33:[function(t,e,n){function r(t,e,n){e||(e=0),"undefined"==typeof n&&(n=t?t.length:0);for(var r=-1,o=n-e||0,i=Array(o<0?0:o);++r<o;)i[r]=t[e+r];return i}e.exports=r},{}],34:[function(t,e,n){e.exports={exists:"undefined"!=typeof window.performance&&window.performance.timing&&"undefined"!=typeof window.performance.timing.navigationStart}},{}],ee:[function(t,e,n){function r(){}function o(t){function e(t){return t&&t instanceof r?t:t?f(t,c,a):a()}function n(n,r,o,i,a){if(a!==!1&&(a=!0),!l.aborted||i){t&&a&&t(n,r,o);for(var s=e(o),c=m(n),f=c.length,u=0;u<f;u++)c[u].apply(s,r);var p=d[y[n]];return p&&p.push([x,n,r,s]),s}}function i(t,e){g[t]=m(t).concat(e)}function h(t,e){var n=g[t];if(n)for(var r=0;r<n.length;r++)n[r]===e&&n.splice(r,1)}function m(t){return g[t]||[]}function v(t){return p[t]=p[t]||o(n)}function w(t,e){l.aborted||u(t,function(t,n){e=e||"feature",y[n]=e,e in d||(d[e]=[])})}var g={},y={},x={on:i,addEventListener:i,removeEventListener:h,emit:n,get:v,listeners:m,context:e,buffer:w,abort:s,aborted:!1};return x}function i(t){return f(t,c,a)}function a(){return new r}function s(){(d.api||d.feature)&&(l.aborted=!0,d=l.backlog={})}var c="nr@context",f=t("gos"),u=t(32),d={},p={},l=e.exports=o();e.exports.getOrSetContext=i,l.backlog=d},{}],gos:[function(t,e,n){function r(t,e,n){if(o.call(t,e))return t[e];var r=n();if(Object.defineProperty&&Object.keys)try{return Object.defineProperty(t,e,{value:r,writable:!0,enumerable:!1}),r}catch(i){}return t[e]=r,r}var o=Object.prototype.hasOwnProperty;e.exports=r},{}],handle:[function(t,e,n){function r(t,e,n,r){o.buffer([t],r),o.emit(t,e,n)}var o=t("ee").get("handle");e.exports=r,r.ee=o},{}],id:[function(t,e,n){function r(t){var e=typeof t;return!t||"object"!==e&&"function"!==e?-1:t===window?0:a(t,i,function(){return o++})}var o=1,i="nr@id",a=t("gos");e.exports=r},{}],loader:[function(t,e,n){function r(){if(!P++){var t=T.info=NREUM.info,e=v.getElementsByTagName("script")[0];if(setTimeout(f.abort,3e4),!(t&&t.licenseKey&&t.applicationID&&e))return f.abort();c(R,function(e,n){t[e]||(t[e]=n)});var n=a();s("mark",["onload",n+T.offset],null,"api"),s("timing",["load",n]);var r=v.createElement("script");0===t.agent.indexOf("http://")||0===t.agent.indexOf("https://")?r.src=t.agent:r.src=h+"://"+t.agent,e.parentNode.insertBefore(r,e)}}function o(){"complete"===v.readyState&&i()}function i(){s("mark",["domContent",a()+T.offset],null,"api")}var a=t(26),s=t("handle"),c=t(32),f=t("ee"),u=t(30),d=t(27),p=t(21),l=t(23),h=p.getConfiguration("ssl")===!1?"http":"https",m=window,v=m.document,w="addEventListener",g="attachEvent",y=m.XMLHttpRequest,x=y&&y.prototype,b=!d(m.location);NREUM.o={ST:setTimeout,SI:m.setImmediate,CT:clearTimeout,XHR:y,REQ:m.Request,EV:m.Event,PR:m.Promise,MO:m.MutationObserver};var E=""+location,R={beacon:"bam.nr-data.net",errorBeacon:"bam.nr-data.net",agent:"js-agent.newrelic.com/nr-spa-1212.min.js"},O=y&&x&&x[w]&&!/CriOS/.test(navigator.userAgent),T=e.exports={offset:a.getLastTimestamp(),now:a,origin:E,features:{},xhrWrappable:O,userAgent:u,disabled:b};if(!b){t(20),t(28),v[w]?(v[w]("DOMContentLoaded",i,l(!1)),m[w]("load",r,l(!1))):(v[g]("onreadystatechange",o),m[g]("onload",r)),s("mark",["firstbyte",a.getLastTimestamp()],null,"api");var P=0}},{}],"wrap-function":[function(t,e,n){function r(t,e){function n(e,n,r,c,f){function nrWrapper(){var i,a,u,p;try{a=this,i=d(arguments),u="function"==typeof r?r(i,a):r||{}}catch(l){o([l,"",[i,a,c],u],t)}s(n+"start",[i,a,c],u,f);try{return p=e.apply(a,i)}catch(h){throw s(n+"err",[i,a,h],u,f),h}finally{s(n+"end",[i,a,p],u,f)}}return a(e)?e:(n||(n=""),nrWrapper[p]=e,i(e,nrWrapper,t),nrWrapper)}function r(t,e,r,o,i){r||(r="");var s,c,f,u="-"===r.charAt(0);for(f=0;f<e.length;f++)c=e[f],s=t[c],a(s)||(t[c]=n(s,u?c+r:r,o,c,i))}function s(n,r,i,a){if(!h||e){var s=h;h=!0;try{t.emit(n,r,i,e,a)}catch(c){o([c,n,r,i],t)}h=s}}return t||(t=u),n.inPlace=r,n.flag=p,n}function o(t,e){e||(e=u);try{e.emit("internal-error",t)}catch(n){}}function i(t,e,n){if(Object.defineProperty&&Object.keys)try{var r=Object.keys(t);return r.forEach(function(n){Object.defineProperty(e,n,{get:function(){return t[n]},set:function(e){return t[n]=e,e}})}),e}catch(i){o([i],n)}for(var a in t)l.call(t,a)&&(e[a]=t[a]);return e}function a(t){return!(t&&t instanceof Function&&t.apply&&!t[p])}function s(t,e){var n=e(t);return n[p]=t,i(t,n,u),n}function c(t,e,n){var r=t[e];t[e]=s(r,n)}function f(){for(var t=arguments.length,e=new Array(t),n=0;n<t;++n)e[n]=arguments[n];return e}var u=t("ee"),d=t(33),p="nr@original",l=Object.prototype.hasOwnProperty,h=!1;e.exports=r,e.exports.wrapFunction=s,e.exports.wrapInPlace=c,e.exports.argsToArray=f},{}]},{},["loader",2,17,5,3,4]); ;NREUM.loader_config={accountID:"804283",trustKey:"804283",agentID:"402703674",licenseKey:"cf99e8d2a3",applicationID:"402703674"} ;NREUM.info={beacon:"bam.nr-data.net",errorBeacon:"bam.nr-data.net",licenseKey:"cf99e8d2a3", // Modified this value from the generated script, to pass prod vs dev applicationID: window.location.hostname.includes('journals.plos.org') ? "402703674" : "402694889", sa:1} </script>  <header> <div id="topslot" class="head-top"> <a id="skip-to-content" tabindex="0" class="button" href="#main-content"> Skip to main content </a> <div class="center"> <div class="title">Advertisement</div>  <div class='advertisement' id='div-gpt-ad-1458247671871-0' style='width:728px; height:90px;'> <script type='text/javascript'> googletag.cmd.push(function() { googletag.display('div-gpt-ad-1458247671871-0'); }); </script> </div> </div> </div> <div id="user" class="nav" data-user-management-url="https://community.plos.org"> </div> <div id="pagehdr"> <nav class="nav-main"> <h1 class="logo"> <a href="/plosone/.">PLOS ONE</a> </h1> <section class="top-bar-section"> <ul class="nav-elements"> <li class="multi-col-parent menu-section-header has-dropdown" id="publish"> Publish <div class="dropdown mega "> <ul class="multi-col" id="publish-dropdown-list"> <li class="menu-section-header " id="submissions"> <span class="menu-section-header-title"> Submissions </span> <ul class="menu-section " id="submissions-dropdown-list"> <li> <a href="/plosone/s/getting-started" >Getting Started</a> </li> <li> <a href="/plosone/s/submission-guidelines" >Submission Guidelines</a> </li> <li> <a href="/plosone/s/figures" >Figures</a> </li> <li> <a href="/plosone/s/tables" >Tables</a> </li> <li> <a href="/plosone/s/supporting-information" >Supporting Information</a> </li> <li> <a href="/plosone/s/latex" >LaTeX</a> </li> <li> <a href="/plosone/s/what-we-publish" >What We Publish</a> </li> <li> <a href="/plosone/s/preprints" >Preprints</a> </li> <li> <a href="/plosone/s/revising-your-manuscript" >Revising Your Manuscript</a> </li> <li> <a href="/plosone/s/submit-now" >Submit Now</a> </li> <li> <a href="https://collections.plos.org/s/calls-for-papers" >Calls for Papers</a> </li> </ul> </li> <li class="menu-section-header " id="policies"> <span class="menu-section-header-title"> Policies </span> <ul class="menu-section " id="policies-dropdown-list"> <li> <a href="/plosone/s/best-practices-in-research-reporting" >Best Practices in Research Reporting</a> </li> <li> <a href="/plosone/s/human-subjects-research" >Human Subjects Research</a> </li> <li> <a href="/plosone/s/animal-research" >Animal Research</a> </li> <li> <a href="/plosone/s/competing-interests" >Competing Interests</a> </li> <li> <a href="/plosone/s/disclosure-of-funding-sources" >Disclosure of Funding Sources</a> </li> <li> <a href="/plosone/s/licenses-and-copyright" >Licenses and Copyright</a> </li> <li> <a href="/plosone/s/data-availability" >Data Availability</a> </li> <li> <a href="/plosone/s/complementary-research" >Complementary Research</a> </li> <li> <a href="/plosone/s/materials-software-and-code-sharing" >Materials, Software and Code Sharing</a> </li> <li> <a href="/plosone/s/ethical-publishing-practice" >Ethical Publishing Practice</a> </li> <li> <a href="/plosone/s/authorship" >Authorship</a> </li> <li> <a href="/plosone/s/corrections-expressions-of-concern-and-retractions" >Corrections, Expressions of Concern, and Retractions</a> </li> </ul> </li> <li class="menu-section-header " id="manuscript-review-and-publication"> <span class="menu-section-header-title"> Manuscript Review and Publication </span> <ul class="menu-section " id="manuscript-review-and-publication-dropdown-list"> <li> <a href="/plosone/s/criteria-for-publication" >Criteria for Publication</a> </li> <li> <a href="/plosone/s/editorial-and-peer-review-process" >Editorial and Peer Review Process</a> </li> <li> <a href="https://plos.org/resources/editor-center" >Editor Center</a> </li> <li> <a href="/plosone/s/resources-for-editors" >Resources for Editors</a> </li> <li> <a href="/plosone/s/reviewer-guidelines" >Guidelines for Reviewers</a> </li> <li> <a href="/plosone/s/accepted-manuscripts" >Accepted Manuscripts</a> </li> <li> <a href="/plosone/s/comments" >Comments</a> </li> </ul> </li> </ul> <div class="calloutcontainer"> <h3 class="callout-headline">Submit Your Manuscript</h3> <div class="action-contain"> <p class="callout-content"> Discover a faster, simpler path to publishing in a high-quality journal. <em>PLOS ONE</em> promises fair, rigorous peer review, broad scope, and wide readership – a perfect fit for your research every time. </p> <p class="button-contain special"> <a class="button button-default" href="/plosone/static/publish"> Learn More </a> <a class="button-link" href="https://www.editorialmanager.com/pone/default.asp"> Submit Now </a> </p> </div>  </div> </div> </li> <li class="menu-section-header has-dropdown " id="about"> <span class="menu-section-header-title"> About </span> <ul class="menu-section dropdown " id="about-dropdown-list"> <li> <a href="/plosone/static/publish" >Why Publish with PLOS ONE</a> </li> <li> <a href="/plosone/s/journal-information" >Journal Information</a> </li> <li> <a href="/plosone/s/staff-editors" >Staff Editors</a> </li> <li> <a href="/plosone/static/editorial-board" >Editorial Board</a> </li> <li> <a href="/plosone/s/section-editors" >Section Editors</a> </li> <li> <a href="/plosone/s/advisory-groups" >Advisory Groups</a> </li> <li> <a href="/plosone/s/find-and-read-articles" >Find and Read Articles</a> </li> <li> <a href="/plosone/s/publishing-information" >Publishing Information</a> </li> <li> <a href="https://plos.org/publication-fees" >Publication Fees</a> </li> <li> <a href="https://plos.org/press-and-media" >Press and Media</a> </li> <li> <a href="/plosone/s/contact" >Contact</a> </li> </ul> </li> <li data-js-tooltip-hover="trigger" class="subject-area menu-section-header"> Browse </li> <script src="/resource/js/vendor/jquery.hoverIntent.js" type="text/javascript"></script> <script src="/resource/js/components/menu_drop.js" type="text/javascript"></script> <script src="/resource/js/components/hover_delay.js" type="text/javascript"></script> <li id="navsearch" class="head-search"> <form name="searchForm" action="/plosone/search" method="get"> <fieldset> <legend>Search</legend> <label for="search">Search</label> <div class="search-contain"> <input id="search" type="text" name="q" placeholder="SEARCH" required/> <button id="headerSearchButton" type="submit" aria-label="Submit search"> <i title="Submit search" class="search-icon"></i> </button> </div> </fieldset> <input type="hidden" name="filterJournals" value="PLoSONE"/> </form> <a id="advSearch" href="/plosone/search"> advanced search </a> <script src="/resource/js/components/placeholder_style.js" type="text/javascript"></script> </li> </ul> </section> </nav> </div> </header> <section id="taxonomyContainer"> <script src="/resource/js/taxonomy-browser.js" type="text/javascript"></script> <div id="taxonomy-browser" class="areas" data-search-url="/plosone/browse"> <div class="wrapper"> <div class="taxonomy-header"> Browse Subject Areas <div id="subjInfo">?</div> <div id="subjInfoText"> <p>Click through the PLOS taxonomy to find articles in your field.</p> <p>For more information about PLOS Subject Areas, click <a href="https://github.com/PLOS/plos-thesaurus/blob/master/README.md" target="_blank" title="Link opens in new window">here</a>. </p> </div> </div> <div class="levels"> <div class="levels-container cf"> <div class="levels-position"></div> </div> <a href="#" class="prev"></a> <a href="#" class="next active"></a> </div> </div> <div class="taxonomy-browser-border-bottom"></div> </div> </section> <main id="main-content"> <div class="set-grid"> <header class="title-block"> <script src="/resource/js/components/signposts.js" type="text/javascript"></script> <ul id="almSignposts" class="signposts"> <li id="loadingMetrics"> <p>Loading metrics</p> </li> </ul> <script type="text/template" id="signpostsGeneralErrorTemplate"> <li id="metricsError">Article metrics are unavailable at this time. Please try again later.</li> </script> <script type="text/template" id="signpostsNewArticleErrorTemplate"> <li></li><li></li><li id="tooSoon">Article metrics are unavailable for recently published articles.</li> </script> <script type="text/template" id="signpostsTemplate"> <li id="almSaves"> <%= s.numberFormat(saveCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosone/article/metrics?id=10.1371/journal.pone.0279433#savedHeader">Save</a> <p class="saves-tip" data-js-tooltip-hover="target"><a href="/plosone/article/metrics?id=10.1371/journal.pone.0279433#savedHeader">Total Mendeley and Citeulike bookmarks.</a></p> </div> </li> <li id="almCitations"> <%= s.numberFormat(citationCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosone/article/metrics?id=10.1371/journal.pone.0279433#citedHeader">Citation</a> <p class="citations-tip" data-js-tooltip-hover="target"><a href="/plosone/article/metrics?id=10.1371/journal.pone.0279433#citedHeader">Paper's citation count computed by Dimensions.</a></p> </div> </li> <li id="almViews"> <%= s.numberFormat(viewCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosone/article/metrics?id=10.1371/journal.pone.0279433#viewedHeader">View</a> <p class="views-tip" data-js-tooltip-hover="target"><a href="/plosone/article/metrics?id=10.1371/journal.pone.0279433#viewedHeader">PLOS views and downloads.</a></p> </div> </li> <li id="almShares"> <%= s.numberFormat(shareCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosone/article/metrics?id=10.1371/journal.pone.0279433#discussedHeader">Share</a> <p class="shares-tip" data-js-tooltip-hover="target"><a href="/plosone/article/metrics?id=10.1371/journal.pone.0279433#discussedHeader">Sum of Facebook, Twitter, Reddit and Wikipedia activity.</a></p> </div> </li> </script> <div class="article-meta"> <div class="classifications"> <p class="license-short" id="licenseShort">Open Access</p> <p class="peer-reviewed" id="peerReviewed">Peer-reviewed</p> <div class="article-type" > <p class="type-article" id="artType">Research Article</p> </div> </div> </div> <div class="article-title-etc"> <div class="title-authors"> <h1 id="artTitle"><?xml version="1.0" encoding="UTF-8"?>Prediction of hospital readmission of multimorbid patients using machine learning models</h1> <ul class="author-list clearfix" data-js-tooltip="tooltip_container" id="author-list"> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="0" class="author-name" > Jules Le Lay <span class="contribute"> </span>,</a> <div id="author-meta-0" class="author-info" data-js-tooltip="tooltip_target"> <p> <span class="contribute"> </span> Contributed equally to this work with: Jules Le Lay, Edgar Alfonso-Lizarazo </p> <p class="roles" id="authRoles"> <span class="type">Roles</span> Formal analysis, Software, Writing – original draft </p> <p id="authAffiliations-0"><span class="type">Affiliation</span> Mines Saint-Etienne, Univ Clermont Auvergne, INP Clermont Auvergne, CNRS, UMR 6158 LIMOS, Centre CIS, Saint-Étienne France </p> <div> <p class="orcid" id="authOrcid-0"> <span> <a id="connect-orcid-link" href="https://orcid.org/0000-0003-4186-5716" target="_blank" title="ORCID Registry"> <img id="orcid-id-logo" src="/resource/img/orcid_16x16.png" width="16" height="16" alt="ORCID logo"/> https://orcid.org/0000-0003-4186-5716 </a> </span> </p> </div> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose0"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="1" class="author-name" > Edgar Alfonso-Lizarazo <span class="contribute"> </span>,</a> <div id="author-meta-1" class="author-info" data-js-tooltip="tooltip_target"> <p> <span class="contribute"> </span> Contributed equally to this work with: Jules Le Lay, Edgar Alfonso-Lizarazo </p> <p class="roles" id="authRoles"> <span class="type">Roles</span> Methodology, Writing – review & editing </p> <p id="authAffiliations-1"><span class="type">Affiliation</span> Université de Lyon, Univ Jean Monnet Saint-Étienne, LASPI, EA3059, Saint-Étienne, France </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose1"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="2" class="author-name" > Vincent Augusto <span class="rel-footnote"> </span> <span class="email"> </span>,</a> <div id="author-meta-2" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Funding acquisition, Methodology </p> <p id="authCorresponding-2"> <span class="email">* E-mail:</span> <a href="mailto:augusto@emse.fr">augusto@emse.fr</a></p> <p><span class="rel-footnote">¶</span>‡ VA and TC also contributed equally to this work.</p> <p id="authAffiliations-2"><span class="type">Affiliation</span> Mines Saint-Etienne, Univ Clermont Auvergne, INP Clermont Auvergne, CNRS, UMR 6158 LIMOS, Centre CIS, Saint-Étienne France </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose2"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="3" class="author-name" > Bienvenu Bongue,</a> <div id="author-meta-3" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Validation, Writing – review & editing </p> <p id="authAffiliations-3"><span class="type">Affiliations</span> Centre technique d’appui et de formation des centers d’examens de santé (CETAF), INSERM, U1059, SAINBIOSE, Dysfonction Vasculaire et Hémostase, Université de Lyon, Université Jean Monnet, Saint-Étienne, France, Chaire Santé des Ainés, University of Jean Monnet, Saint-Étienne, France </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose3"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="4" class="author-name" > Malek Masmoudi,</a> <div id="author-meta-4" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Supervision, Writing – review & editing </p> <p id="authAffiliations-4"><span class="type">Affiliation</span> University of Sharjah, College of Engineering, Sharjah, United Arab Emirates </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose4"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="5" class="author-name" > Xiaolan Xie,</a> <div id="author-meta-5" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Project administration, Supervision </p> <p id="authAffiliations-5"><span class="type">Affiliation</span> Mines Saint-Etienne, Univ Clermont Auvergne, INP Clermont Auvergne, CNRS, UMR 6158 LIMOS, Centre CIS, Saint-Étienne France </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose5"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="6" class="author-name" > Baptiste Gramont,</a> <div id="author-meta-6" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Data curation, Validation </p> <p id="authAffiliations-6"><span class="type">Affiliation</span> Department of Internal Medicine, University Hospital of Saint-Etienne, Saint-Étienne, France </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose6"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="7" class="author-name" > Thomas Célarier <span class="rel-footnote"> </span></a> <div id="author-meta-7" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Data curation, Validation </p> <p><span class="rel-footnote">¶</span>‡ VA and TC also contributed equally to this work.</p> <p id="authAffiliations-7"><span class="type">Affiliations</span> Chaire Santé des Ainés, University of Jean Monnet, Saint-Étienne, France, Department of Clinical Gerontology, University Hospital of Saint-Etienne, Saint-Étienne, France, Gérontopôle Auvergne-Rhône-Alpes, Saint-Étienne, France </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose7"> ⨯ </a> </div> </li> </ul> <script src="/resource/js/components/tooltip.js" type="text/javascript"></script> </div> <div id="floatTitleTop" data-js-floater="title_author" class="float-title" role="presentation"> <div class="set-grid"> <div class="float-title-inner"> <h1><?xml version="1.0" encoding="UTF-8"?>Prediction of hospital readmission of multimorbid patients using machine learning models</h1> <ul id="floatAuthorList" data-js-floater="floated_authors"> <li data-float-index="1">Jules Le Lay,  </li> <li data-float-index="2">Edgar Alfonso-Lizarazo,  </li> <li data-float-index="3">Vincent Augusto,  </li> <li data-float-index="4">Bienvenu Bongue,  </li> <li data-float-index="5">Malek Masmoudi,  </li> <li data-float-index="6">Xiaolan Xie,  </li> <li data-float-index="7">Baptiste Gramont,  </li> <li data-float-index="8">Thomas Célarier </li> </ul> </div> <div class="logo-close" id="titleTopCloser"> <img src="/resource/img/logo-plos.png" style="height: 2em" alt="PLOS" /> <div class="close-floater" title="close">x</div> </div> </div> </div> <ul class="date-doi"> <li id="artPubDate">Published: December 22, 2022</li> <li id="artDoi"> <a href="https://doi.org/10.1371/journal.pone.0279433">https://doi.org/10.1371/journal.pone.0279433</a> </li> <li class="flex-spacer"></li> </ul> </div> <div> </div> </header> <section class="article-body"> <ul class="article-tabs"> <li class="tab-title active" id="tabArticle"> <a href="/plosone/article?id=10.1371/journal.pone.0279433" class="article-tab-1">Article</a> </li> <li class="tab-title " id="tabAuthors"> <a href="/plosone/article/authors?id=10.1371/journal.pone.0279433" class="article-tab-2">Authors</a> </li> <li class="tab-title " id="tabMetrics"> <a href="/plosone/article/metrics?id=10.1371/journal.pone.0279433" class="article-tab-3">Metrics</a> </li> <li class="tab-title " id="tabComments"> <a href="/plosone/article/comments?id=10.1371/journal.pone.0279433" class="article-tab-4">Comments</a> </li> <li class="tab-title" id="tabRelated"> <a class="article-tab-5" id="tabRelated-link">Media Coverage</a> <script>$(document).ready(function() { $.getMediaLink("10.1371/journal.pone.0279433").then(function (url) { $("#tabRelated-link").attr("href", url) } ) })</script> </li> <li class="tab-title " id="tabPeerReview"> <a href="/plosone/article/peerReview?id=10.1371/journal.pone.0279433" class="article-tab-6">Peer Review</a> </li> </ul> <div class="article-container"> <div id="nav-article"> <ul class="nav-secondary"> <li class="nav-comments" id="nav-comments"> <a href="article/comments?id=10.1371/journal.pone.0279433">Reader Comments</a> </li> <li id="nav-figures"><a href="#" data-doi="10.1371/journal.pone.0279433">Figures</a></li> </ul> <div id="nav-data-linking" data-data-url=""> </div> </div> <script src="/resource/js/components/scroll.js" type="text/javascript"></script> <script src="/resource/js/components/nav_builder.js" type="text/javascript"></script> <script src="/resource/js/components/floating_nav.js" type="text/javascript"></script> <div id="figure-lightbox-container"></div> <script id="figure-lightbox-template" type="text/template"> <div id="figure-lightbox" class="reveal-modal full" data-reveal aria-hidden="true" role="dialog"> <div class="lb-header"> <h1 id="lb-title"><%= articleTitle %></h1> <div id="lb-authors"> <span>Jules Le Lay</span> <span>Edgar Alfonso-Lizarazo</span> <a class="more-authors" href="/plosone/article/authors?id=10.1371/journal.pone.0279433">...</a> <span>Thomas Célarier</span> </div> <div class="lb-close" title="close"> </div> </div> <div class="img-container"> <div class="loader"> <i class="fa-spinner"></i> </div> <img class="main-lightbox-image" src=""/> <aside id="figures-list"> <% figureList.each(function (ix, figure) { %> <div class="change-img" data-doi="<%= figure.getAttribute('data-doi') %>"> <img class="aside-figure" src="/plosone/article/figure/image?size=inline&id=<%= figure.getAttribute('data-doi') %>" /> </div> <% }) %> <div class="dummy-figure"> </div> </aside> </div> <div id="lightbox-footer"> <div id="btns-container" class="lightbox-row <% if(figureList.length <= 1) { print('one-figure-only') } %>"> <div class="fig-btns-container reset-zoom-wrapper left"> <span class="fig-btn reset-zoom-btn">Reset zoom</span> </div> <div class="zoom-slider-container"> <div class="range-slider-container"> <span id="lb-zoom-min"></span> <div class="range-slider round" data-slider data-options="start: 20; end: 200; initial: 20;"> <span class="range-slider-handle" role="slider" tabindex="0"></span> <span class="range-slider-active-segment"></span> <input type="hidden"> </div> <span id="lb-zoom-max"></span> </div> </div> <% if(figureList.length > 1) { %> <div class="fig-btns-container"> <span class="fig-btn all-fig-btn"><i class="icon icon-all"></i> All Figures</span> <span class="fig-btn next-fig-btn"><i class="icon icon-next"></i> Next</span> <span class="fig-btn prev-fig-btn"><i class="icon icon-prev"></i> Previous</span> </div> <% } %> </div> <div id="image-context"> </div> </div> </div> </script> <script id="image-context-template" type="text/template"> <div class="footer-text"> <div id="figure-description-wrapper"> <div id="view-more-wrapper" style="<% descriptionExpanded? print('display:none;') : '' %>"> <span id="figure-title"><%= title %></span> <p id="figure-description"> <%= description %>   </p> <span id="view-more">show more<i class="icon-arrow-right"></i></span> </div> <div id="view-less-wrapper" style="<% descriptionExpanded? print('display:inline-block;') : '' %>" > <span id="figure-title"><%= title %></span> <p id="full-figure-description"> <%= description %>   <span id="view-less">show less<i class="icon-arrow-left"></i></span> </p> </div> </div> </div> <div id="show-context-container"> <a class="btn show-context" href="<%= showInContext(strippedDoi) %>">Show in Context</a> </div> <div id="download-buttons"> <h3>Download:</h3> <div class="item"> <a href="/plosone/article/figure/image?size=original&download=&id=<%= doi %>" title="original image"> <span class="download-btn">TIFF</span> </a> <span class="file-size"><%= fileSizes.original %></span> </div> <div class="item"> <a href="/plosone/article/figure/image?size=large&download=&id=<%= doi %>" title="large image"> <span class="download-btn">PNG</span> </a> <span class="file-size"><%= fileSizes.large %></span> </div> <div class="item"> <a href="/plosone/article/figure/powerpoint?id=<%= doi %>" title="PowerPoint slide"> <span class="download-btn">PPT</span> </a> </div> </div> </script> <div class="article-content"> <div id="figure-carousel-section"> <h2>Figures</h2> <div id="figure-carousel"> <div class="carousel-wrapper"> <div class="slider"> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0279433.t001"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0279433.t001" loading="lazy" alt="Table 1" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0279433.g001"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0279433.g001" loading="lazy" alt="Fig 1" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0279433.t002"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0279433.t002" loading="lazy" alt="Table 2" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0279433.t003"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0279433.t003" loading="lazy" alt="Table 3" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0279433.g002"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0279433.g002" loading="lazy" alt="Fig 2" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0279433.g003"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0279433.g003" loading="lazy" alt="Fig 3" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0279433.t004"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0279433.t004" loading="lazy" alt="Table 4" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0279433.t005"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0279433.t005" loading="lazy" alt="Table 5" /> </div> </div> </div> <div class="carousel-control"> <span class="button previous"></span> <span class="button next"></span> </div> <div class="carousel-page-buttons"> </div> </div> </div> <script src="/resource/js/vendor/jquery.touchswipe.js" type="text/javascript"></script> <script src="/resource/js/components/figure_carousel.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.dotdotdot.js" type="text/javascript"></script> <div class="article-text" id="artText"> <div xmlns:plos="http://plos.org" class="abstract toc-section abstract-type-"><a id="abstract0" name="abstract0" data-toc="abstract0" class="link-target" title="Abstract"></a><h2>Abstract</h2><div class="abstract-content"> <div id="section1" class="section toc-section"><a id="sec001" name="sec001" class="link-target" title="Objective"></a> <h3>Objective</h3> <a id="article1.front1.article-meta1.abstract1.sec1.p1" name="article1.front1.article-meta1.abstract1.sec1.p1" class="link-target"></a><p>The objective of this study is twofold. First, we seek to understand the characteristics of the multimorbid population that needs hospital care by using all diagnoses information (ICD-10 codes) and two aggregated multimorbidity and frailty scores. Second, we use machine learning prediction models on these multimorbid patients characteristics to predict rehospitalization within 30 and 365 days and their length of stay.</p> </div> <div id="section2" class="section toc-section"><a id="sec002" name="sec002" class="link-target" title="Methods"></a> <h3>Methods</h3> <a id="article1.front1.article-meta1.abstract1.sec2.p1" name="article1.front1.article-meta1.abstract1.sec2.p1" class="link-target"></a><p>This study was conducted on 8 882 anonymized patients hospitalized at the University Hospital of Saint-Étienne. A descriptive statistical analysis was performed to better understand the characteristics of the patient population. Multimorbidity was measured using raw diagnoses information and two specific scores based on clusters of diagnoses: the Hospital Frailty Risk Score and the Calderon-Larrañaga index. Based on these variables different machine learning models (Decision Tree, Random forest and k-nearest Neighbors) were used to predict near future rehospitalization and length of stay (LoS).</p> </div> <div id="section3" class="section toc-section"><a id="sec003" name="sec003" class="link-target" title="Results"></a> <h3>Results</h3> <a id="article1.front1.article-meta1.abstract1.sec3.p1" name="article1.front1.article-meta1.abstract1.sec3.p1" class="link-target"></a><p>The use of random forest algorithms yielded better performance to predict both 365 and 30 days rehospitalization and using the diagnoses ICD-10 codes directly was significantly more efficient. However, using the Calderon-Larrañaga’s clusters of diagnoses can be used as an efficient substitute for diagnoses information for predicting readmission. The predictive power of the algorithms is quite low on length of stay indicator.</p> </div> <div id="section4" class="section toc-section"><a id="sec004" name="sec004" class="link-target" title="Conclusion"></a> <h3>Conclusion</h3> <a id="article1.front1.article-meta1.abstract1.sec4.p1" name="article1.front1.article-meta1.abstract1.sec4.p1" class="link-target"></a><p>Using machine learning techniques using patients’ diagnoses information and Calderon-Larrañaga’s score yielded efficient results to predict hospital readmission of multimorbid patients. These methods could help improve the management of care of multimorbid patients in hospitals.</p> </div> </div></div> <div xmlns:plos="http://plos.org" class="articleinfo"><p><strong>Citation: </strong>Le Lay J, Alfonso-Lizarazo E, Augusto V, Bongue B, Masmoudi M, Xie X, et al. (2022) Prediction of hospital readmission of multimorbid patients using machine learning models. PLoS ONE 17(12): e0279433. https://doi.org/10.1371/journal.pone.0279433</p><p><strong>Editor: </strong>Antonio De Vincentis, University Campus Bio-Medico di Roma, ITALY </p><p><strong>Received: </strong>March 24, 2022; <strong>Accepted: </strong>December 7, 2022; <strong>Published: </strong> December 22, 2022</p><p><strong>Copyright: </strong> © 2022 Le Lay et al. This is an open access article distributed under the terms of the <a href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution License</a>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.</p><p><strong>Data Availability: </strong>The data cannot be shared publicly. Data are available from the CNIL for researchers who meet the criteria for access to confidential data (data accessed with CNIL authorization number 919300). CNIL web site: <a href="https://www.cnil.fr/">https://www.cnil.fr/</a>.</p><p><strong>Funding: </strong>This work was funded by the ‘Agence Nationale de la Recherche’, which funded the thesis on the study of multimorbid pathways under grant number ANR-18-CE19-0016. (thesis of author JLL, project manager VA). <a href="https://anr.fr/">https://anr.fr/</a> The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</p><p><strong>Competing interests: </strong> The authors have declared that no competing interests exist.</p></div> <div xmlns:plos="http://plos.org" id="section1" class="section toc-section"><a id="sec005" name="sec005" data-toc="sec005" class="link-target" title="Introduction"></a><h2>Introduction</h2><a id="article1.body1.sec1.p1" name="article1.body1.sec1.p1" class="link-target"></a><p>The management for care of multimorbid patients, in hospitals is a rising concern among the scientific community. Multimorbid patients tend to have more complex needs and require coordinated care from several providers [<a href="#pone.0279433.ref001" class="ref-tip">1</a>]. Multimorbidity, defined as the “co-occurrence of multiple chronic or acute diseases and medical conditions within one person” [<a href="#pone.0279433.ref002" class="ref-tip">2</a>], is highly prevalent in Europe. Based on the Survey on Health, Aging and Retirement in Europe (SHARE) Nielsen et al. [<a href="#pone.0279433.ref003" class="ref-tip">3</a>] found that 31.42% of the participants above 50 years old in 14 European countries and Israel were affected by multimorbidity.. Southern Europe (Italy, Spain, France and Israel) and Northern Europe (Denmark, Sweden, and the Netherlands) had a slightly lower multimorbidity prevalence (29.8% and 26.2% respectively).</p> <a id="article1.body1.sec1.p2" name="article1.body1.sec1.p2" class="link-target"></a><p>Currently, there are multiple research projects to improve the overall quality of care both inside and outside of healthcare centers, establishing dedicated care pathways for multimorbid patients [<a href="#pone.0279433.ref004" class="ref-tip">4</a>–<a href="#pone.0279433.ref006" class="ref-tip">6</a>].</p> <a id="article1.body1.sec1.p3" name="article1.body1.sec1.p3" class="link-target"></a><p>Barnett et al. [<a href="#pone.0279433.ref007" class="ref-tip">7</a>] reported an association between age, sex, deprivation and multimorbidity based on a list of 40 medical conditions. This list was built using policy recommendations and important chronic conditions identified in [<a href="#pone.0279433.ref008" class="ref-tip">8</a>]. However, counting conditions can be quite limiting, and are a controversial measure of multimorbidity for these studies [<a href="#pone.0279433.ref009" class="ref-tip">9</a>]. [<a href="#pone.0279433.ref010" class="ref-tip">10</a>] highlighted the importance of using a standard measure of multimorbidity to analyze and compare the results of studies in which different scores have been built to describe multimorbidity.</p> <a id="article1.body1.sec1.p4" name="article1.body1.sec1.p4" class="link-target"></a><p>The most common measure of multimorbidity is the Charlson comorbidity index score, originally introduced in 1987 [<a href="#pone.0279433.ref011" class="ref-tip">11</a>] and first updated in 1994 [<a href="#pone.0279433.ref012" class="ref-tip">12</a>] and numerous times since to be applied with administrative databases [<a href="#pone.0279433.ref013" class="ref-tip">13</a>, <a href="#pone.0279433.ref014" class="ref-tip">14</a>] or to predict other outcomes [<a href="#pone.0279433.ref015" class="ref-tip">15</a>]. In a recent systematic review, [<a href="#pone.0279433.ref009" class="ref-tip">9</a>] explored the different multimorbidity measures developed outside of the counts of conditions. The hospital frailty risk score (HFRS), which uses weighted counts [<a href="#pone.0279433.ref016" class="ref-tip">16</a>] or the Calderon-Larrañaga score, which counts clusters of diagnoses groups [<a href="#pone.0279433.ref017" class="ref-tip">17</a>] are other ways to build a more efficient index.</p> <a id="article1.body1.sec1.p5" name="article1.body1.sec1.p5" class="link-target"></a><p>Healthcare services can be monitored through several performance indicators. In this study we are interested in the patients’ readmission and length of stay (LoS) indicators. Rehospitalization (or readmission) can be defined as “an admission to a hospital within a certain time frame (which can be 7, 15, 30,60, 90 days or even as long as a year) following an original (index) admission and discharge” [<a href="#pone.0279433.ref018" class="ref-tip">18</a>]. According to [<a href="#pone.0279433.ref019" class="ref-tip">19</a>], monitoring readmission and predicting the readmission of patients during their initial hospitalization are essential for two main reasons. First, authorities use this metric to evaluate and report the efficiency of healthcare centers, where a higher readmission count is being associated with lower efficiency. Second, providing a clinically relevant readmission risk early in a hospitalization stay allows hospital workers to trigger preventive action and avoid subsequent admission, improving the consumption of medical supplies and the cost-effectiveness of the patients’ care. This metric, from a cost-effectiveness perspective, is even more crucial for patients with additional chronic conditions as comorbidities that are associated with higher costs of care [<a href="#pone.0279433.ref020" class="ref-tip">20</a>]. The LoS in hospitals is a key quality of care metric for patients and care providers, it relates to the occupancy rate of the service and is used to improve the care given.</p> <a id="article1.body1.sec1.p6" name="article1.body1.sec1.p6" class="link-target"></a><p>Machine learning is a powerful set of data analysis techniques that identify and use patterns in data to realize predictions without explicitly specifying the procedure. Its use in healthcare over the past years has been extensive for the prediction of outcomes, as shown in [<a href="#pone.0279433.ref021" class="ref-tip">21</a>]. A scoping review recently covered the use of machine learning algorithms for the prediction of hospital readmission [<a href="#pone.0279433.ref022" class="ref-tip">22</a>]. According to this review there is a relatively high interest in tree-based methods (decision trees, random forest and boosted tree methods), although other techniques as neural networks and regularized logistic regression are also used. [<a href="#pone.0279433.ref023" class="ref-tip">23</a>] predicted the LoS of stroke patients using J48 and a Bayesian network.</p> <a id="article1.body1.sec1.p7" name="article1.body1.sec1.p7" class="link-target"></a><p>The objectives of the study presented in this article are 1) to describe the characteristics of elderly multimorbid patients in the studied hospital using diagnoses information, multimorbidity and frailty scores, and 2) to assess the ability of machine learning models to predict rehospitalization within 30 and 365 days and patients’ length of stay, using diagnoses information and two aggregative scores: the hospital frailty risk score and the Calderon-Larrañaga score.</p> </div> <div xmlns:plos="http://plos.org" id="section2" class="section toc-section"><a id="sec006" name="sec006" data-toc="sec006" class="link-target" title="Materials and methods"></a><h2>Materials and methods</h2> <div id="section1" class="section toc-section"><a id="sec007" name="sec007" class="link-target" title="Data description"></a> <h3>Data description</h3> <a id="article1.body1.sec2.sec1.p1" name="article1.body1.sec2.sec1.p1" class="link-target"></a><p>The data used in the present study were extracted from the anonymized patients’ electronic records of the hospital of Saint-Étienne (CHUSE) under ‘Commission Nationale Informatique et Libertés’ (CNIL) authorization number 919300, that also waived the need for consent [<a href="#pone.0279433.ref024" class="ref-tip">24</a>]. An exception to the obligation to inform the patient was granted, as the effort required to contact all the patients involved in the study was deemed disproportionate. All patient data accessed during this research was anonymyzed. CHUSE is a university hospital at the heart of the regional healthcare network: -<em>Groupement Hospitalier de la Loire</em>. In 2019, CHUSE had more than one hundred thousand stays in one of the thousand beds in the medicine, surgery and obstetrics areas.</p> <a id="article1.body1.sec2.sec1.p2" name="article1.body1.sec2.sec1.p2" class="link-target"></a><p>We focused on adult patients above 60 years old hospitalized in the CHUSE and discharged in 2017 with diagnoses in 2 different chapters of the ICD-10 classification. We excluded patients following a highly controlled care pathway, such as dialysis or outpatient surgery, except when this outpatient care led to an extended hospital stay.</p> <a id="article1.body1.sec2.sec1.p3" name="article1.body1.sec2.sec1.p3" class="link-target"></a><p>For each stay we analyzed variables related to the general information of the patient as well as information concerning their care pathway. These variables are listed below:</p> <ul class="bulleted"> <li>anonymous patient identifier</li> <li>age and sex of the patient</li> <li>service sequence</li> <li>date of admission in each unit</li> <li>length of stay (LoS) at each service of the sequence</li> <li>total length of stay (sum of the length of stays in individual services)</li> <li>admission modality and origin of the patient</li> <li>discharge modality and destination of the patient</li> <li>the list of diagnoses made at each service</li> </ul><a id="article1.body1.sec2.sec1.p4" name="article1.body1.sec2.sec1.p4" class="link-target"></a><p>From this list we were able to predict the same-hospital readmission within 30 and 365 days by linking the different stays of a unique patient using his/her anonymous identifier.</p> <a id="article1.body1.sec2.sec1.p5" name="article1.body1.sec2.sec1.p5" class="link-target"></a><p>As previously mentioned there are numerous methods in the literature to describe multimorbidity. To compare the different approaches, we decided in this study capture multimorbidity by using all diagnoses information and using two multimorbidity scores: the hospital frailty risk score [<a href="#pone.0279433.ref016" class="ref-tip">16</a>] and the Calderon-Larrañaga score [<a href="#pone.0279433.ref017" class="ref-tip">17</a>].</p> <a id="article1.body1.sec2.sec1.p6" name="article1.body1.sec2.sec1.p6" class="link-target"></a><p>The hospital frailty risk score [<a href="#pone.0279433.ref016" class="ref-tip">16</a>] was developed to identify older patients presenting frailty diagnoses. A higher risk score is associated with a higher risk of adverse outcomes and a higher use of medical resources. Weights were calculated using logistic regression targetting of the identified frail population and validated for the prediction of adverse outcomes.</p> <a id="article1.body1.sec2.sec1.p7" name="article1.body1.sec2.sec1.p7" class="link-target"></a><p>Calderon-Larrañaga [<a href="#pone.0279433.ref017" class="ref-tip">17</a>] explored a different approach. To build this multimorbidity score, [<a href="#pone.0279433.ref017" class="ref-tip">17</a>] gathered a panel of medical experts to group diagnoses into categories according to “clinical criteria and relevance (pathophysiological pathway, treatment, prognosis, and prevalence)” and defined the score of a patient as the number of categories where the patients had at least one diagnosis.</p> <a id="article1.body1.sec2.sec1.p8" name="article1.body1.sec2.sec1.p8" class="link-target"></a><p>In order to capture the multimorbidity by using all diagnosis information, we built a database containing the exhaustive list of diagnoses made to the patient during their stay (3-digit ICD-10 codes) to compare the performance obtained by creating thematic groups of diagnoses.</p> <a id="article1.body1.sec2.sec1.p9" name="article1.body1.sec2.sec1.p9" class="link-target"></a><p>The Charlson comorbidity index score was computed for comparative purposes using the ICD-10 translation of the index established by [<a href="#pone.0279433.ref013" class="ref-tip">13</a>]; however, this score was not used for predictive procedures.</p> </div> <div id="section2" class="section toc-section"><a id="sec008" name="sec008" class="link-target" title="Statistical analysis methodology"></a> <h3>Statistical analysis methodology</h3> <a id="article1.body1.sec2.sec2.p1" name="article1.body1.sec2.sec2.p1" class="link-target"></a><p>The use of different measures to synthesize multimorbidity in the literature and the tendency to use exhaustive data in process mining raises the question of the relevance of using aggregated scores in advanced statistical procedures. For this reason we compare the ability of several machine learning algorithms to predict readmission within 30 and 365 days and length of stay in the elderly multimorbid patient population using all diagnosis information and two multimorbidity scores: the hospital frailty risk score (HFRS) [<a href="#pone.0279433.ref016" class="ref-tip">16</a>] and the Calderon-Larrañaga score [<a href="#pone.0279433.ref017" class="ref-tip">17</a>]. In our study, we also use different categories of the Calderon-Larrañaga’s and HFRS, to perform our statistical analysis and assess the loss of predictive power when aggregating the scores. For the Calderon-Larrañaga score we use the categories, and for HFRS we use groups of diagnoses having an equal weight in the score’s calculation. We will refer to these nonaggregated versions of the scores as Calderon-Larrañaga portfolio and HFRS portfolio in the remainder of the paper. In the portfolio versions of the measures the category information was coded as a binary value equal to 1 if the category/diagnosis was active for the patient. We chose HFRS because it was designed to predict frailty and was validated for the prediction of 30-day readmission [<a href="#pone.0279433.ref016" class="ref-tip">16</a>]. As mentioned before we built a database containing an exhaustive list of diagnoses made during the patients’ stay (3-digit ICD-10 codes).</p> <a id="article1.body1.sec2.sec2.p2" name="article1.body1.sec2.sec2.p2" class="link-target"></a><p>It is important to note that for the readmission analysis we excluded patients who died during their initial hospitalization, as readmission is not applicable for deceased patients. This resulted in the exclusion of 780 patients from the readmission database. However, we kept the data from these patients to predict length of stay. Palliative care or complex pathologies and care resulting in the death of the patient might be associated with longer hospital stays.</p> <a id="article1.body1.sec2.sec2.p3" name="article1.body1.sec2.sec2.p3" class="link-target"></a><p>However, it is also important to note that for this study we only have access to the patients’ data during their hospitalization, which means that we do not have access to their status after one year.</p> <a id="article1.body1.sec2.sec2.p4" name="article1.body1.sec2.sec2.p4" class="link-target"></a><p>The machine learning methods used in this study for prediction of hospital readmission were tree classifier, a random forest classifier and a k-nearest neighbor classifier.</p> <a id="article1.body1.sec2.sec2.p5" name="article1.body1.sec2.sec2.p5" class="link-target"></a><p>For the length of stay prediction we used a tree regressor and a random forest regressor. All experiments were performed using Python 3.7, pandas [<a href="#pone.0279433.ref025" class="ref-tip">25</a>, <a href="#pone.0279433.ref026" class="ref-tip">26</a>] and scikit-learn [<a href="#pone.0279433.ref027" class="ref-tip">27</a>].</p> <a id="article1.body1.sec2.sec2.p6" name="article1.body1.sec2.sec2.p6" class="link-target"></a><p>For all learning experiments, the data were split between training and testing samples, with the training sample representing 75% of the original dataset. We used a grid search with cross-validation to parametrize the learning algorithms. The parameters that were tested and optimized were the depth and number of leaves for the decision tree approach, the depth, number of leaves and number of estimators for the random forest approach and the algorithm, leaf size and number of neighbors for the k-nearest neighbors approach.</p> <a id="article1.body1.sec2.sec2.p7" name="article1.body1.sec2.sec2.p7" class="link-target"></a><p>As previously mentioned, we used the patients’ anonymous identifiers to identify the patients stays. In addition to diagnosis information, we used the age, sex, length of stay, ED admission information and number of steps in the pathway to predict the same-hospital readmission within 30 days and 365 after discharge of the initial stay from the inpatient database. Those variables and the residential zip code (except the length of stay), were used for the prediction of length of stay.</p> <a id="article1.body1.sec2.sec2.p8" name="article1.body1.sec2.sec2.p8" class="link-target"></a><p>The class size of readmitted patients within 30 days (1 965, or 15.86% of the stays) appeared to be far smaller than that of nonreadmitted patients. To address these imbalanced classes, we performed resampling techniques on the dataset using the imbalanced-learn Python package presented in [<a href="#pone.0279433.ref028" class="ref-tip">28</a>] and used appropriate metrics to evaluate the results.</p> <a id="article1.body1.sec2.sec2.p9" name="article1.body1.sec2.sec2.p9" class="link-target"></a><p>Resampling is a method that changes the composition of the dataset to allow training on a balanced dataset. There are techniques that delete samples from the majority class, others that generate samples of the minority class and some that combines the two. We used the imbalanced-learn Python package presented in [<a href="#pone.0279433.ref028" class="ref-tip">28</a>]. The different methods were applied to train the learning algorithm on the balanced dataset, and we selected the best performing combination of resampling and learning algorithm. For the prediction of hospital readmission within 30 days we used the same 3 classifier algorithms: decision tree, random forest and k-nearest neighbor.</p> <a id="article1.body1.sec2.sec2.p10" name="article1.body1.sec2.sec2.p10" class="link-target"></a><p>Some metrics such as accuracy are not an appropriate target to assess the performance of algorithms when dealing with unbalanced datasets. Therefore, we decided to focus on the F1-score, a weighted average of precision and recall, and receiving operating characteristic area under the curve (ROC-AUC) which compares sensitivity and specificity. Thus, we will have a better understanding of the classifier’s efficiency.</p> <a id="article1.body1.sec2.sec2.p11" name="article1.body1.sec2.sec2.p11" class="link-target"></a><p>To evaluate regression algorithms, we used two well-known metrics: mean absolute error and mean squared error. The classifiers’ performances were assessed using accuracy (percentage of correctly predicted instance) and F1-score for rehospitalization within 365 days and receiver operating characteristic area under curve and F1-score for hospitalization within 30 days, where patients were unevenly distributed between positive and negative classes.</p> </div> <div id="section3" class="section toc-section"><a id="sec009" name="sec009" class="link-target" title="Database"></a> <h3>Database</h3> <a id="article1.body1.sec2.sec3.p1" name="article1.body1.sec2.sec3.p1" class="link-target"></a><p> <a href="#pone-0279433-t001">Table 1</a> presents the general variables used by the prediction algorithm. Additionally the algorithms use information on the diagnoses made to the patients. Five versions of this database were coded in order to compare the diagnoses information and aggregated multimorbidity scores:</p> <ol class="order"> <li>using raw information on the diagnoses: one column per diagnoses with binary values;</li> <li>using Calderon-Larrañaga score;</li> <li>using Calderon-Larrañaga portfolio (as explained in section Statistical Analysis Methodology);</li> <li>using the HFRS score; and</li> <li>using the HFRS portfolio.</li> </ol><a class="link-target" id="pone-0279433-t001" name="pone-0279433-t001"></a><div class="figure" data-doi="10.1371/journal.pone.0279433.t001"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0279433.t001" data-doi="10.1371/journal.pone.0279433" data-uri="10.1371/journal.pone.0279433.t001"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0279433.t001" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0279433.t001"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0279433.t001"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0279433.t001"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 1. </span> General variables regarding the patient and descriptive information on their values.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0279433.t001"> https://doi.org/10.1371/journal.pone.0279433.t001</a></p></div><a id="article1.body1.sec2.sec3.p2" name="article1.body1.sec2.sec3.p2" class="link-target"></a><p>These features were used to train and test prediction models targeting (i) readmission within 365 days, (ii) readmission within 30 days after the end of the initial hospitalization and (iii) the total length of stay.</p> </div> </div> <div xmlns:plos="http://plos.org" id="section3" class="section toc-section"><a id="sec010" name="sec010" data-toc="sec010" class="link-target" title="Results"></a><h2>Results</h2> <div id="section1" class="section toc-section"><a id="sec011" name="sec011" class="link-target" title="Epidemiological description"></a> <h3>Epidemiological description</h3> <a id="article1.body1.sec3.sec1.p1" name="article1.body1.sec3.sec1.p1" class="link-target"></a><p>As specified above, we include patients above 60 years old with diagnoses in 2 different categories of ICD-10 classification who were discharged in 2017 in our study. This database includes 12 391 hospital stays of 8 882 unique patients (4 541 male patients and 4 341 female patients). The distribution of ages for this population is shown in <a href="#pone-0279433-g001">Fig 1</a>. On the left side of the graph are male patients, and on the right side of the graph are female patients.</p> <a class="link-target" id="pone-0279433-g001" name="pone-0279433-g001"></a><div class="figure" data-doi="10.1371/journal.pone.0279433.g001"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0279433.g001" data-doi="10.1371/journal.pone.0279433" data-uri="10.1371/journal.pone.0279433.g001"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0279433.g001" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0279433.g001"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0279433.g001"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0279433.g001"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Fig 1. </span> Age pyramid of the multimorbid patients of the hospital of Saint-Étienne (male patients on the left side of the graph and female patients on the right side of the graph).</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0279433.g001"> https://doi.org/10.1371/journal.pone.0279433.g001</a></p></div><a id="article1.body1.sec3.sec1.p2" name="article1.body1.sec3.sec1.p2" class="link-target"></a><p>We observe that the mean age for both male and female patients is quite high (74.73 and 77.93 respectively), with a median (74 and 79 years old, respectively). In our study, it was more likely that older multimorbid people were more susceptible to hospitalization.</p> <a id="article1.body1.sec3.sec1.p3" name="article1.body1.sec3.sec1.p3" class="link-target"></a><p>We calculated the age-adjusted Charlson comorbidity index score [<a href="#pone.0279433.ref012" class="ref-tip">12</a>], the Calderon-Larrañaga score [<a href="#pone.0279433.ref017" class="ref-tip">17</a>] and the HFRS [<a href="#pone.0279433.ref016" class="ref-tip">16</a>] for each patient. The mean age-adjusted Charlson’s score was 5.65, the mean Calderon-Larrañaga’s score was 4.94 and the mean HFRS was 6.32. The mean absolute difference between age-adjusted Charlson comorbidity and Calderon-Larrañaga scores was 2.39, which shows how the different scores highlight different multimorbidity profiles.</p> <a id="article1.body1.sec3.sec1.p4" name="article1.body1.sec3.sec1.p4" class="link-target"></a><p> <a href="#pone-0279433-t002">Table 2</a> shows the ten ICD-10 codes that are the most frequently diagnosed in the 12 391 stays of the database. Eight out of these 10 codes refer to chronic diseases, among them we can notice hypertension, that appears in 51.6% of the stays, type 2 diabetes mellitus (25.7%), overweight and obesity (13.4%), and chronic ischemic heart diseases (13.3%).</p> <a class="link-target" id="pone-0279433-t002" name="pone-0279433-t002"></a><div class="figure" data-doi="10.1371/journal.pone.0279433.t002"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0279433.t002" data-doi="10.1371/journal.pone.0279433" data-uri="10.1371/journal.pone.0279433.t002"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0279433.t002" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0279433.t002"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0279433.t002"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0279433.t002"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 2. </span> The ten most frequent diagnoses appearing in the database.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0279433.t002"> https://doi.org/10.1371/journal.pone.0279433.t002</a></p></div></div> <div id="section2" class="section toc-section"><a id="sec012" name="sec012" class="link-target" title="Prediction of readmission within 365 days"></a> <h3>Prediction of readmission within 365 days</h3> <a id="article1.body1.sec3.sec2.p1" name="article1.body1.sec3.sec2.p1" class="link-target"></a><p>The results obtained from the different combination of algorithm and multimorbidity evaluation are displayed in <a href="#pone-0279433-t003">Table 3</a>. We display the mean observed value and the 95% confidence interval calculated using a bootstrap method.</p> <a class="link-target" id="pone-0279433-t003" name="pone-0279433-t003"></a><div class="figure" data-doi="10.1371/journal.pone.0279433.t003"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0279433.t003" data-doi="10.1371/journal.pone.0279433" data-uri="10.1371/journal.pone.0279433.t003"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0279433.t003" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0279433.t003"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0279433.t003"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0279433.t003"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 3. </span> Accuracy, F1-score and computation times obtained for the prediction of readmission within 365 days.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0279433.t003"> https://doi.org/10.1371/journal.pone.0279433.t003</a></p></div><a id="article1.body1.sec3.sec2.p2" name="article1.body1.sec3.sec2.p2" class="link-target"></a><p>Random forest appears to be the best performing algorithm. The best performance measures, accuracy (0.826) and f1-score (0.812), are obtained by using all diagnosis information. Using the aggregated multimorbidity and frailty scores returns smaller performances. However by using the components of the scores (portfolios) the performance improves. For example using Calderon-Larrañaga’s portfolio we obtain an accuracy of 0.730 and F1-score of 0.704. For HFRS with components we obtain 0.719 and 0.696 respectively with the random forest classifiers. A similar behavior is observed with KNN classifiers.</p> <a id="article1.body1.sec3.sec2.p3" name="article1.body1.sec3.sec2.p3" class="link-target"></a><p>Although using all diagnostic information provides the best performance, the computational time is higher compared to the computation time of the aggregated multimorbidity scores.</p> <a id="article1.body1.sec3.sec2.p4" name="article1.body1.sec3.sec2.p4" class="link-target"></a><p>A good time-performance trade-off is obtained by using Calderon-Larrañaga portfolio and random forest, as the decrease in accuracy and F1-score is small (−0.096 and −0.108, respectively), with a net improvement in the computation time. Using the HFRS portfolio and random forest is the second best option. These performance gains can be explained by the thematic groups of diagnoses created by the experts specifically for the score, which must result in easier analysis for the algorithms. Both metrics indicate that the random-forest algorithm, used on the Calderon-Larrañaga and HFRS portfolios are viable alternatives for the prediction of hospital rehospitalization within 365 days.</p> </div> <div id="section3" class="section toc-section"><a id="sec013" name="sec013" class="link-target" title="Prediction of readmission within 30 days"></a> <h3>Prediction of readmission within 30 days</h3> <a id="article1.body1.sec3.sec3.p1" name="article1.body1.sec3.sec3.p1" class="link-target"></a><p>As presented in section, we implemented resampling methods to train the algorithms on balanced training sets before testing it on unbalanced sets. We used oversampling (random oversampling, synthetic minority oversampling technique or SMOTE and variations), undersampling (random undersampling, near miss, condensed nearest neighbors, Tomek links, edited nearest neighbors) techniques, as well as mixed methods (SMOTE combined with edited nearest neighbors (SMOTE-ENN) or SMOTE combined with Tomek links). All related results are available in <a href="#pone-0279433-g002">Fig 2</a> of the appendix <em>Results of the resampling techniques used to predict the within 30 day readmission</em>.</p> <a class="link-target" id="pone-0279433-g002" name="pone-0279433-g002"></a><div class="figure" data-doi="10.1371/journal.pone.0279433.g002"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0279433.g002" data-doi="10.1371/journal.pone.0279433" data-uri="10.1371/journal.pone.0279433.g002"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0279433.g002" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0279433.g002"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0279433.g002"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0279433.g002"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Fig 2. </span> Results of the different resampling techniques and classifiers for the prediction of readmission within 30 days.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0279433.g002"> https://doi.org/10.1371/journal.pone.0279433.g002</a></p></div><a id="article1.body1.sec3.sec3.p2" name="article1.body1.sec3.sec3.p2" class="link-target"></a><p>We singled out the most efficient combinations of classifier and resampling techniques for each dataset to perform a grid search with cross validation when considering the combination of F1-score and ROC-AUC. For the five datasets, it appeared that random undersampling was the most efficient technique.</p> <a id="article1.body1.sec3.sec3.p3" name="article1.body1.sec3.sec3.p3" class="link-target"></a><p>The performance is higher when the algorithm considers all information related to the patients’ diagnoses, as seen in <a href="#pone-0279433-t004">Table 4</a>. For example the combination of random forest and random undersampling with all diagnoses information provides an ROC-AUC score of 0.625 with a 95% Confidence Interval (CI) of [0.602–0.649] on the testing samples. Similar to the results for readmission within 365 days, using Calderon-Larrañaga portfolio is more efficient than using the aggregated score alone. With an ROC-AUC score of 0.594 [0.573–0.620] this algorithm gives the best result after all diagnoses and is significantly more efficient than the experiments using HFRS. The ROC curves and calibration curves are displayed in <a href="#pone-0279433-g003">Fig 3</a>. We note that the results are quite different for HFRS, and the ROC-AUC and F1-score are both comparable for the two versions of this multimorbidity index (the HFRS score and HFRS portfolio).</p> <a class="link-target" id="pone-0279433-g003" name="pone-0279433-g003"></a><div class="figure" data-doi="10.1371/journal.pone.0279433.g003"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0279433.g003" data-doi="10.1371/journal.pone.0279433" data-uri="10.1371/journal.pone.0279433.g003"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0279433.g003" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0279433.g003"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0279433.g003"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0279433.g003"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Fig 3. </span> Results of the different resampling techniques and classifiers for the prediction of readmission within 30 days.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0279433.g003"> https://doi.org/10.1371/journal.pone.0279433.g003</a></p></div><a class="link-target" id="pone-0279433-t004" name="pone-0279433-t004"></a><div class="figure" data-doi="10.1371/journal.pone.0279433.t004"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0279433.t004" data-doi="10.1371/journal.pone.0279433" data-uri="10.1371/journal.pone.0279433.t004"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0279433.t004" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0279433.t004"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0279433.t004"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0279433.t004"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 4. </span> Accuracy, F1-score and ROC-AUC results obtained for the prediction of readmission within 30 days.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0279433.t004"> https://doi.org/10.1371/journal.pone.0279433.t004</a></p></div></div> <div id="section4" class="section toc-section"><a id="sec014" name="sec014" class="link-target" title="Prediction of length of stay"></a> <h3>Prediction of length of stay</h3> <a id="article1.body1.sec3.sec4.p1" name="article1.body1.sec3.sec4.p1" class="link-target"></a><p>Overall, the random forest algorithm performed better than the decision tree, with an improvement of 10 to 30 square days in mean squared error from the decision tree results. This improvement is the most significant when using all available diagnoses (-0.802 MAE and -30.462 MSE). These results can not be considered conclusive as the best mean absolute error is still above 5 days, which represents half of the mean length of stay in the database. The raw results are displayed in <a href="#pone-0279433-t005">Table 5</a>.</p> <a class="link-target" id="pone-0279433-t005" name="pone-0279433-t005"></a><div class="figure" data-doi="10.1371/journal.pone.0279433.t005"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0279433.t005" data-doi="10.1371/journal.pone.0279433" data-uri="10.1371/journal.pone.0279433.t005"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0279433.t005" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0279433.t005"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0279433.t005"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0279433.t005"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 5. </span> Length of stay prediction results.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0279433.t005"> https://doi.org/10.1371/journal.pone.0279433.t005</a></p></div></div> </div> <div xmlns:plos="http://plos.org" id="section4" class="section toc-section"><a id="sec015" name="sec015" data-toc="sec015" class="link-target" title="Discussion"></a><h2>Discussion</h2><a id="article1.body1.sec4.p1" name="article1.body1.sec4.p1" class="link-target"></a><p>In this study we included patients based on the number of diagnoses in different ICD-10 categories, before applying different scores (the Charlson comorbidity score, Calderon-Larrañaga score and HFRS).</p> <a id="article1.body1.sec4.p2" name="article1.body1.sec4.p2" class="link-target"></a><p>The mean age of the studied patients is 76 years. In addition, female multimorbid patients tend to be older than male patients. The mean age-adjusted Charlson morbidity score was 5.65, and the mean Calderon-Larrañaga score was 4.94. The most prevalent diseases diagnosed in patients were hypertension and type 2 diabetes mellitus.</p> <a id="article1.body1.sec4.p3" name="article1.body1.sec4.p3" class="link-target"></a><p>We built 5 versions of our database for each outcome, each taking into account various information on the diagnosis. The raw diagnosis information was compared to 2 aggregation scores: the HFRS, a score built to measure the frailty of patients based on diagnoses information, and the Calderon-Larrañaga score, a multimorbidity score based on groups of diagnoses.</p> <a id="article1.body1.sec4.p4" name="article1.body1.sec4.p4" class="link-target"></a><p>The prediction of medium-term readmission was efficient, with the best score achieved using random forest and all diagnoses information (an accuracy score of 0.826 [0.811–0.840] and a F1-score of 0.812 [0.794–0.829]). Using Calderon-Larrañaga portfolio resulted in a slight decrease in performance for both indicators (−0.096 and −0.108 respectively). We believe that the clusters of diseases used in Calderon-Larrañaga portfolio can be used as an efficient substitute of diagnoses information for predicting readmission within 365 days after initial discharge.</p> <a id="article1.body1.sec4.p5" name="article1.body1.sec4.p5" class="link-target"></a><p>We tested multiple resampling solutions to account for the imbalance in the rehospitalization within 30 days dataset. We obtained at best an ROC-AUC score of 0.625, which is acceptable, although it is slightly lower than the recent results in the literature, as [<a href="#pone.0279433.ref022" class="ref-tip">22</a>] reported a median AUC of 0.68 on the studies they identified. The accuracy on the unbalanced testing set is of 0.603. When using the combination of Calderon-Larrañaga portfolio, random forest and random undersampling, we obtained a mean ROC-AUC score of 0.594 and a mean accuracy of 0.556. The use of Calderon-Larrañaga portfolio can be a viable alternative for the prediction of the within 30 day readmission on a medico-administrative database.</p> <a id="article1.body1.sec4.p6" name="article1.body1.sec4.p6" class="link-target"></a><p>Overall, the predictive power of our algorithms is quite low for length of stay prediction. The use of a random forest regressor gave the best results for the two metrics used, MAE and MSE. Both the HFRS and the Calderon-Larrañaga score were outperformed by the use of all information on diagnosis. However, the HFRS performed better than the Calderon-Larrañaga score. The HFRS seems to be an acceptable alternative to the use of exhaustive information on diagnosis with a random forest algorithm for predicting length of stay.</p> <a id="article1.body1.sec4.p7" name="article1.body1.sec4.p7" class="link-target"></a><p>In general, the experiments show that for readmission within 365 days, using all diagnosis gives the best results. The Calderon-Larrañaga and HFRS give comparable results. Calderon-Larrañaga portfolio gives significantly better results than the experiments using HFRS scores and portfolio for the prediction of readmission within 30 days, but is still outperformed by the random forest with a random undersampling on all diagnosis information. The different experiments show that the machine learning algorithms for the prediction of length of stay give at best a mean absolute error of 5.208 and mean square error of 72.687 (random forest used with HFRS score).</p> <a id="article1.body1.sec4.p8" name="article1.body1.sec4.p8" class="link-target"></a><p>Calderon-Larrañaga portfolio is a standardized and thorough tool that accounts for most ICD-10 codes and chronic conditions, and we believe that it gives a quite accurate view on multimorbidity. Thus, it can be a good alternative to using the raw information on diagnoses for predicting readmission within 365 and 30 days.</p> <a id="article1.body1.sec4.p9" name="article1.body1.sec4.p9" class="link-target"></a><p>The main limitations of this study are related to the lack of information on the vital status of patients after their hospitalization. This could represent a bias, as it is possible that patients died between the initial discharge and the end of the period of interest. Thus, the absence of a hospital stay within 30 or 365 days after discharge may be caused by the death of the patient.</p> <a id="article1.body1.sec4.p10" name="article1.body1.sec4.p10" class="link-target"></a><p>A key component of multimorbidity according to Barnett et al. [<a href="#pone.0279433.ref007" class="ref-tip">7</a>] that we could not grasp in this study is the socioeconomic aspect. Similar to [<a href="#pone.0279433.ref007" class="ref-tip">7</a>], we can use geographical information as a proxy, but we do not have access in the present database to an evaluation of the socioeconomic status per area. In addition, we have access only to the residential zip-code of the patient, which can cover quite a large area and hide many disparities between patients. A favorable familial situation, with an available caregiver, is a key component of the support and recovery of patients, and this information is not available to us. We believe that these two key components of care for multimorbid patients would be a valuable addition when using the methodology presented in this paper.</p> </div> <div xmlns:plos="http://plos.org" id="section5" class="section toc-section"><a id="sec016" name="sec016" data-toc="sec016" class="link-target" title="Conclusion"></a><h2>Conclusion</h2><a id="article1.body1.sec5.p1" name="article1.body1.sec5.p1" class="link-target"></a><p>In this study we described the general characteristics of the multimorbid population hospitalized in the CHUSE in 2017 using diagnoses information, multimorbidity or frailty scores and various machine learning techniques were used to predict key components of the hospitalization pathway: the length of stay and the rehospitalization within 30 and 365 days after initial discharge.</p> <a id="article1.body1.sec5.p2" name="article1.body1.sec5.p2" class="link-target"></a><p>Random forrest algorithms were the most efficient for predicting those three outcomes. Using all diagnoses information gave better results at the price of high calculation times. Using the Calderon-Larrañaga portfolio is an efficient alternative for rehospitalization within 30 and 365 days. However, for LoS prediction, the HFRS metrics gave the best results.</p> <a id="article1.body1.sec5.p3" name="article1.body1.sec5.p3" class="link-target"></a><p>For future research, we intend to apply prediction techniques on patient data to single out complicated pathways and combine this with the results obtained in this study in a discrete event simulation model. Our goal is to evaluate the organizational impact of redirecting those patients toward a newly created unit, dedicated to multimorbid patients. It would also be of interest to combine the approach of this paper with prospective data at admission, which would provide additional valuable information, such as socioeconomic data and familial context, respecting the anonymity of patients. This could allow us to evaluate if the patient would be fit for the new multimorbid pathway and to track the decision process of the care team when deciding in which unit the patient must be routed.</p> </div> <div xmlns:plos="http://plos.org" id="section6" class="section toc-section"><a id="sec017" name="sec017" data-toc="sec017" class="link-target" title="Appendices: Results of the resampling techniques used to predict the within 30 day readmission"></a><h2>Appendices: Results of the resampling techniques used to predict the within 30 day readmission</h2><a id="article1.body1.sec6.p1" name="article1.body1.sec6.p1" class="link-target"></a><p> <a href="#pone-0279433-g002">Fig 2</a> shows the results obtained when testing the different resampling techniques. The algorithms were trained on a dataset balanced using the specified resampling technique using a random search with cross validation from the scikit-learn package [<a href="#pone.0279433.ref027" class="ref-tip">27</a>]. Only the ROC-AUC score on the testing set is displayed here.</p> </div> <div xmlns:plos="http://plos.org" id="section7" class="section toc-section"><a id="sec018" name="sec018" data-toc="sec018" class="link-target" title="Appendices: ROC and calibration curves for the prediction of readmission within 30 days"></a><h2>Appendices: ROC and calibration curves for the prediction of readmission within 30 days</h2><a id="article1.body1.sec7.p1" name="article1.body1.sec7.p1" class="link-target"></a><p> <a href="#pone-0279433-g003">Fig 3</a> displays the ROC and calibration curves for the 5 best performing algorithms for predicting 30 days all-cause readmission. We used the scikit-learn package [<a href="#pone.0279433.ref027" class="ref-tip">27</a>] functions to generate those curves. They were generated using the testing set.</p> </div> <div xmlns:plos="http://plos.org" class="toc-section"><a id="references" name="references" class="link-target" data-toc="references" title="References"></a><h2>References</h2><ol class="references"><li id="ref1"><span class="order">1. </span><a name="pone.0279433.ref001" id="pone.0279433.ref001" class="link-target"></a> Rijken M, Struckmann V, van der Heide I, Hujala A, Barbabella F, van Ginneken E, et al. How to improve care for people with multimorbidity in Europe? Richardson E, Van Ginneken E, editors. European Observatory Policy Briefs. Copenhagen (Denmark): European Observatory on Health Systems and Policies; 2017. Available from: <a href="http://www.ncbi.nlm.nih.gov/books/NBK464548/">http://www.ncbi.nlm.nih.gov/books/NBK464548/</a>. <ul class="find-nolinks"></ul></li><li id="ref2"><span class="order">2. </span><a name="pone.0279433.ref002" id="pone.0279433.ref002" class="link-target"></a> van den Akker M, Buntinx F, Knottnerus JA. Comorbidity or multimorbidity: what’s in a name? A review of literature. European Journal of General Practice. 1996;2(2):65–70. <ul class="reflinks" data-doi="10.3109/13814789609162146"><li><a href="https://doi.org/10.3109/13814789609162146" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Comorbidity+or+multimorbidity%3A+what%E2%80%99s+in+a+name%3F+A+review+of+literature+van+den+Akker+1996" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref3"><span class="order">3. </span><a name="pone.0279433.ref003" id="pone.0279433.ref003" class="link-target"></a> Nielsen C.R. and Halling A. and Andersen-Ranberg K. Disparities in multimorbidity across Europe—Findings from the SHARE Survey European Geriatric Medicine. 2017;1(8):16–21. <ul class="reflinks" data-doi="10.1016/j.eurger.2016.11.010"><li><a href="https://doi.org/10.1016/j.eurger.2016.11.010" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Disparities+in+multimorbidity+across+Europe%E2%80%94Findings+from+the+SHARE+Survey+Nielsen+2017" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref4"><span class="order">4. </span><a name="pone.0279433.ref004" id="pone.0279433.ref004" class="link-target"></a> Rijken M, Hujala A, van Ginneken E, Melchiorre MG, Groenewegen P, Schellevis F. Managing multimorbidity: Profiles of integrated care approaches targeting people with multiple chronic conditions in Europe. Health Policy. 2018;122(1):44–52. pmid:29102089 <ul class="reflinks" data-doi="10.1016/j.healthpol.2017.10.002"><li><a href="https://doi.org/10.1016/j.healthpol.2017.10.002" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/29102089" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Managing+multimorbidity%3A+Profiles+of+integrated+care+approaches+targeting+people+with+multiple+chronic+conditions+in+Europe+Rijken+2018" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref5"><span class="order">5. </span><a name="pone.0279433.ref005" id="pone.0279433.ref005" class="link-target"></a> van der Heide I, Snoeijs SP, Boerma WG, Schellevis FG, Rijken MP. How to strengthen patient-centredness in caring for people with multimorbidity in Europe? Richardson E, Van Ginneken E, editors. European Observatory Policy Briefs. Copenhagen (Denmark): European Observatory on Health Systems and Policies; 2017. Available from: <a href="http://www.ncbi.nlm.nih.gov/books/NBK464537/">http://www.ncbi.nlm.nih.gov/books/NBK464537/</a>. <ul class="find-nolinks"></ul></li><li id="ref6"><span class="order">6. </span><a name="pone.0279433.ref006" id="pone.0279433.ref006" class="link-target"></a> Shakib S, Dundon BK, Maddison J, Thomas J, Stanners M, Caughey GE, et al. Effect of a Multidisciplinary Outpatient Model of Care on Health Outcomes in Older Patients with Multimorbidity: A Retrospective Case Control Study. PloS One. 2016;11(8):e0161382. pmid:27537395 <ul class="reflinks" data-doi="10.1371/journal.pone.0161382"><li><a href="https://doi.org/10.1371/journal.pone.0161382" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/27537395" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Effect+of+a+Multidisciplinary+Outpatient+Model+of+Care+on+Health+Outcomes+in+Older+Patients+with+Multimorbidity%3A+A+Retrospective+Case+Control+Study+Shakib+2016" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref7"><span class="order">7. </span><a name="pone.0279433.ref007" id="pone.0279433.ref007" class="link-target"></a> Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. The Lancet. 2012;380(9836):37–43. pmid:22579043 <ul class="reflinks" data-doi="10.1016/S0140-6736(12)60240-2"><li><a href="https://doi.org/10.1016/S0140-6736(12)60240-2" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/22579043" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Epidemiology+of+multimorbidity+and+implications+for+health+care%2C+research%2C+and+medical+education%3A+a+cross-sectional+study+Barnett+2012" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref8"><span class="order">8. </span><a name="pone.0279433.ref008" id="pone.0279433.ref008" class="link-target"></a> Diederichs C, Berger K, Bartels DB. The Measurement of Multiple Chronic Diseases—A Systematic Review on Existing Multimorbidity Indices. The Journals of Gerontology: Series A. 2010;66A(3):301–311. pmid:21112963 <ul class="reflinks" data-doi="10.1093/gerona/glq208"><li><a href="https://doi.org/10.1093/gerona/glq208" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/21112963" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=The+Measurement+of+Multiple+Chronic+Diseases%E2%80%94A+Systematic+Review+on+Existing+Multimorbidity+Indices+Diederichs+2010" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref9"><span class="order">9. </span><a name="pone.0279433.ref009" id="pone.0279433.ref009" class="link-target"></a> Stirland LE, González-Saavedra L, Mullin DS, Ritchie CW, Muniz-Terrera G, Russ TC. Measuring multimorbidity beyond counting diseases: systematic review of community and population studies and guide to index choice. BMJ. 2020; p. m160. pmid:32071114 <ul class="reflinks" data-doi="10.1136/bmj.m160"><li><a href="https://doi.org/10.1136/bmj.m160" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/32071114" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Measuring+multimorbidity+beyond+counting+diseases%3A+systematic+review+of+community+and+population+studies+and+guide+to+index+choice+Stirland+2020" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref10"><span class="order">10. </span><a name="pone.0279433.ref010" id="pone.0279433.ref010" class="link-target"></a> Diederichs C, Bartels DB, Berger K. The Importance Of A Standardized Instrument To Assess The Burden Of Multimorbidity. The Journals of Gerontology: Series A. 2011;66A(12):1395–1396. <ul class="reflinks" data-doi="10.1093/gerona/glr162"><li><a href="https://doi.org/10.1093/gerona/glr162" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=The+Importance+Of+A+Standardized+Instrument+To+Assess+The+Burden+Of+Multimorbidity+Diederichs+2011" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref11"><span class="order">11. </span><a name="pone.0279433.ref011" id="pone.0279433.ref011" class="link-target"></a> Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. Journal of Chronic Diseases. 1987;40(5):373–383. pmid:3558716 <ul class="reflinks" data-doi="10.1016/0021-9681(87)90171-8"><li><a href="https://doi.org/10.1016/0021-9681(87)90171-8" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/3558716" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=A+new+method+of+classifying+prognostic+comorbidity+in+longitudinal+studies%3A+Development+and+validation+Charlson+1987" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref12"><span class="order">12. </span><a name="pone.0279433.ref012" id="pone.0279433.ref012" class="link-target"></a> Charlson ME, Szatrowski T, Peterson J, Gold J. Validation of a combined multimorbidity index. Journal of Clinical Epidemiology. 1994;47(11):1245–1151. pmid:7722560 <ul class="reflinks" data-doi="10.1016/0895-4356(94)90129-5"><li><a href="https://doi.org/10.1016/0895-4356(94)90129-5" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/7722560" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Validation+of+a+combined+multimorbidity+index+Charlson+1994" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref13"><span class="order">13. </span><a name="pone.0279433.ref013" id="pone.0279433.ref013" class="link-target"></a> Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, et al. Coding Algorithms for Defining Comorbidities in ICD-9-CM and ICD-10 Administrative Data. Medical Care. 2005;43(11):1130–1139. pmid:16224307 <ul class="reflinks" data-doi="10.1097/01.mlr.0000182534.19832.83"><li><a href="https://doi.org/10.1097/01.mlr.0000182534.19832.83" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/16224307" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Coding+Algorithms+for+Defining+Comorbidities+in+ICD-9-CM+and+ICD-10+Administrative+Data+Quan+2005" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref14"><span class="order">14. </span><a name="pone.0279433.ref014" id="pone.0279433.ref014" class="link-target"></a> Sundararajan V, Henderson T, Perry C, Muggivan A, Quan H, Ghali WA. New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality. Journal of Clinical Epidemiology. 2004;57(12):1288–1294. pmid:15617955 <ul class="reflinks" data-doi="10.1016/j.jclinepi.2004.03.012"><li><a href="https://doi.org/10.1016/j.jclinepi.2004.03.012" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/15617955" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=New+ICD-10+version+of+the+Charlson+comorbidity+index+predicted+in-hospital+mortality+Sundararajan+2004" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref15"><span class="order">15. </span><a name="pone.0279433.ref015" id="pone.0279433.ref015" class="link-target"></a> Quan H, Li B, Couris CM, Fushimi K, Graham P, Hider P, et al. Updating and Validating the Charlson Comorbidity Index and Score for Risk Adjustment in Hospital Discharge Abstracts Using Data From 6 Countries. American Journal of Epidemiology. 2011;173(6):676–682. pmid:21330339 <ul class="reflinks" data-doi="10.1093/aje/kwq433"><li><a href="https://doi.org/10.1093/aje/kwq433" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/21330339" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Updating+and+Validating+the+Charlson+Comorbidity+Index+and+Score+for+Risk+Adjustment+in+Hospital+Discharge+Abstracts+Using+Data+From+6+Countries+Quan+2011" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref16"><span class="order">16. </span><a name="pone.0279433.ref016" id="pone.0279433.ref016" class="link-target"></a> Gilbert T, Neuburger J, Kraindler J, Keeble E, Smith P, Ariti C, et al. Development and validation of a Hospital Frailty Risk Score focusing on older people in acute care settings using electronic hospital records: an observational study. The Lancet. 2018;391(10132):1775–1782. pmid:29706364 <ul class="reflinks" data-doi="10.1016/S0140-6736(18)30668-8"><li><a href="https://doi.org/10.1016/S0140-6736(18)30668-8" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/29706364" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Development+and+validation+of+a+Hospital+Frailty+Risk+Score+focusing+on+older+people+in+acute+care+settings+using+electronic+hospital+records%3A+an+observational+study+Gilbert+2018" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref17"><span class="order">17. </span><a name="pone.0279433.ref017" id="pone.0279433.ref017" class="link-target"></a> Calderón-Larrañaga A, Vetrano DL, Onder G, Gimeno-Feliu LA, Coscollar-Santaliestra C, Carfí A, et al. Assessing and Measuring Chronic Multimorbidity in the Older Population: A Proposal for Its Operationalization. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences. 2016. <ul class="reflinks" data-doi="10.1093/gerona/glw233"><li><a href="https://doi.org/10.1093/gerona/glw233" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Assessing+and+Measuring+Chronic+Multimorbidity+in+the+Older+Population%3A+A+Proposal+for+Its+Operationalization+Calder%C3%B3n-Larra%C3%B1aga+2016" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref18"><span class="order">18. </span><a name="pone.0279433.ref018" id="pone.0279433.ref018" class="link-target"></a> Yu S, Farooq F, van Esbroeck A, Fung G, Anand V, Krishnapuram B. Predicting readmission risk with institution-specific prediction models. Artificial Intelligence in Medicine. 2015;65(2):89–96. pmid:26363683 <ul class="reflinks" data-doi="10.1016/j.artmed.2015.08.005"><li><a href="https://doi.org/10.1016/j.artmed.2015.08.005" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/26363683" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Predicting+readmission+risk+with+institution-specific+prediction+models+Yu+2015" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref19"><span class="order">19. </span><a name="pone.0279433.ref019" id="pone.0279433.ref019" class="link-target"></a> Kansagara D, Englander H, Salanitro A, Kagen D, Theobald C, Freeman M, et al. Risk Prediction Models for Hospital Readmission: A Systematic Review. JAMA. 2011;306(15):1688–1698. pmid:22009101 <ul class="reflinks" data-doi="10.1001/jama.2011.1515"><li><a href="https://doi.org/10.1001/jama.2011.1515" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/22009101" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Risk+Prediction+Models+for+Hospital+Readmission%3A+A+Systematic+Review+Kansagara+2011" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref20"><span class="order">20. </span><a name="pone.0279433.ref020" id="pone.0279433.ref020" class="link-target"></a> Shwartz M, Iezzoni LI, Moskowitz MA, Ash AS, Sawitz E. The Importance of Comorbidities in Explaining Differences in Patient Costs. Medical Care. 1996;34(8):767–782. pmid:8709659 <ul class="reflinks" data-doi="10.1097/00005650-199608000-00005"><li><a href="https://doi.org/10.1097/00005650-199608000-00005" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/8709659" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=The+Importance+of+Comorbidities+in+Explaining+Differences+in+Patient+Costs+Shwartz+1996" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref21"><span class="order">21. </span><a name="pone.0279433.ref021" id="pone.0279433.ref021" class="link-target"></a>Shailaja K, Seetharamulu B, Jabbar MA. Machine Learning in Healthcare: A Review. In: 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA); 2018. p. 910–914. <ul class="find-nolinks"></ul></li><li id="ref22"><span class="order">22. </span><a name="pone.0279433.ref022" id="pone.0279433.ref022" class="link-target"></a> Huang Y, Talwar A, Chatterjee S, Aparasu RR. Application of machine learning in predicting hospital readmissions: a scoping review of the literature. BMC Medical Research Methodology. 2021;21(1):96. pmid:33952192 <ul class="reflinks" data-doi="10.1186/s12874-021-01284-z"><li><a href="https://doi.org/10.1186/s12874-021-01284-z" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/33952192" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Application+of+machine+learning+in+predicting+hospital+readmissions%3A+a+scoping+review+of+the+literature+Huang+2021" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref23"><span class="order">23. </span><a name="pone.0279433.ref023" id="pone.0279433.ref023" class="link-target"></a>Al Taleb AR, Hoque M, Hasanat A, Khan MB. Application of data mining techniques to predict length of stay of stroke patients. In: 2017 International Conference on Informatics, Health Technology (ICIHT); 2017. p. 1–5. <ul class="find-nolinks"></ul></li><li id="ref24"><span class="order">24. </span><a name="pone.0279433.ref024" id="pone.0279433.ref024" class="link-target"></a>Commission Nationale de l’Informatique et des Libertés. <a href="https://www.cnil.fr/en/home">https://www.cnil.fr/en/home</a> <ul class="find-nolinks"></ul></li><li id="ref25"><span class="order">25. </span><a name="pone.0279433.ref025" id="pone.0279433.ref025" class="link-target"></a>Team TPD. pandas-dev/pandas: Pandas 1.3.2; 2021. Available from: <a href="https://doi.org/10.5281/zenodo.5203279">https://doi.org/10.5281/zenodo.5203279</a>. <ul class="find-nolinks"></ul></li><li id="ref26"><span class="order">26. </span><a name="pone.0279433.ref026" id="pone.0279433.ref026" class="link-target"></a>Wes McKinney. Data Structures for Statistical Computing in Python. In: Stéfan van der Walt, Jarrod Millman, editors. Proceedings of the 9th Python in Science Conference; 2010. p. 56 – 61. <ul class="find-nolinks"></ul></li><li id="ref27"><span class="order">27. </span><a name="pone.0279433.ref027" id="pone.0279433.ref027" class="link-target"></a> Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research. 2011;12:2825–2830. <ul class="reflinks"><li><a href="#" data-author="Pedregosa" data-cit="%0APedregosaF%2C%20VaroquauxG%2C%20GramfortA%2C%20MichelV%2C%20ThirionB%2C%20GriselO%2C%20et%20al.%20Scikit-learn%3A%20Machine%20Learning%20in%20Python.%20Journal%20of%20Machine%20Learning%20Research.%202011%3B12%3A2825%E2%80%932830." data-title="Scikit-learn%3A%20Machine%20Learning%20in%20Python" target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Scikit-learn%3A+Machine+Learning+in+Python+Pedregosa+2011" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref28"><span class="order">28. </span><a name="pone.0279433.ref028" id="pone.0279433.ref028" class="link-target"></a> Lemaître G, Nogueira F, Aridas CK. Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning. Journal of Machine Learning Research. 2017;18(17):1–5. <ul class="reflinks"><li><a href="#" data-author="Lema%C3%AEtre" data-cit="%0ALema%C3%AEtreG%2C%20NogueiraF%2C%20AridasCK.%20Imbalanced-learn%3A%20A%20Python%20Toolbox%20to%20Tackle%20the%20Curse%20of%20Imbalanced%20Datasets%20in%20Machine%20Learning.%20Journal%20of%20Machine%20Learning%20Research.%202017%3B18%2817%29%3A1%E2%80%935." data-title="Imbalanced-learn%3A%20A%20Python%20Toolbox%20to%20Tackle%20the%20Curse%20of%20Imbalanced%20Datasets%20in%20Machine%20Learning" target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Imbalanced-learn%3A+A+Python+Toolbox+to+Tackle+the+Curse+of+Imbalanced+Datasets+in+Machine+Learning+Lema%C3%AEtre+2017" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li></ol></div> <div class="ref-tooltip"> <div class="ref_tooltip-content"> </div> </div> </div> </div> </div> </section> <aside class="article-aside">  <div class="dload-menu"> <div class="dload-pdf"> <a href="/plosone/article/file?id=10.1371/journal.pone.0279433&type=printable" id="downloadPdf" target="_blank">Download PDF</a> </div> <div data-js-tooltip-hover="trigger" class="dload-hover">  <ul class="dload-xml" data-js-tooltip-hover="target"> <li><a href="/plosone/article/citation?id=10.1371/journal.pone.0279433" id="downloadCitation">Citation</a></li> <li><a href="/plosone/article/file?id=10.1371/journal.pone.0279433&type=manuscript" id="downloadXml">XML</a> </li> </ul> </div> </div> <div class="aside-container"> <div class="print-article" id="printArticle" data-js-tooltip-hover="trigger"> <a href="#" onclick="window.print(); return false;" class="preventDefault" id="printBrowser">Print</a> </div> <div class="share-article" id="shareArticle" data-js-tooltip-hover="trigger"> Share <ul data-js-tooltip-hover="target" class="share-options" id="share-options"> <li><a href="https://www.reddit.com/submit?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0279433" id="shareReddit" target="_blank" title="Submit to Reddit"><img src="/resource/img/icon.reddit.16.png" width="16" height="16" alt="Reddit">Reddit</a></li> <li><a href="https://www.facebook.com/share.php?u=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0279433&t=Prediction of hospital readmission of multimorbid patients using machine learning models" id="shareFacebook" target="_blank" title="Share on Facebook"><img src="/resource/img/icon.fb.16.png" width="16" height="16" alt="Facebook">Facebook</a></li> <li><a href="https://www.linkedin.com/shareArticle?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0279433&title=Prediction of hospital readmission of multimorbid patients using machine learning models&summary=Checkout this article I found at PLOS" id="shareLinkedIn" target="_blank" title="Add to LinkedIn"><img src="/resource/img/icon.linkedin.16.png" width="16" height="16" alt="LinkedIn">LinkedIn</a></li> <li><a href="https://www.mendeley.com/import/?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0279433" id="shareMendeley" target="_blank" title="Add to Mendeley"><img src="/resource/img/icon.mendeley.16.png" width="16" height="16" alt="Mendeley">Mendeley</a></li> <li><a href="https://twitter.com/intent/tweet?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0279433&text=%23PLOSONE%3A%20Prediction of hospital readmission of multimorbid patients using machine learning models" target="_blank" title="share on Twitter" id="twitter-share-link"><img src="/resource/img/icon.twtr.16.png" width="16" height="16" alt="Twitter">Twitter</a></li> <li><a href="mailto:?subject=Prediction of hospital readmission of multimorbid patients using machine learning models&body=I%20thought%20you%20would%20find%20this%20article%20interesting.%20From%20PLOS ONE:%20https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0279433" id="shareEmail" rel="noreferrer" aria-label="Email"><img src="/resource/img/icon.email.16.png" width="16" height="16" alt="Email">Email</a></li> <script src="/resource/js/components/tweet140.js" type="text/javascript"></script> </ul> </div> </div>  <script src="https://crossmark-cdn.crossref.org/widget/v2.0/widget.js"></script> <a aria-label="Check for updates via CrossMark" data-target="crossmark"> <img alt="Check for updates via CrossMark" width="150" src="https://crossmark-cdn.crossref.org/widget/v2.0/logos/CROSSMARK_BW_horizontal.svg"> </a>  <div class="aside-container collections-aside-container"></div> <div class="skyscraper-container"> <div class="title">Advertisement</div>  <div class='advertisement' id='div-gpt-ad-1458247671871-1' style='width:160px; height:600px;'> <script type='text/javascript'> googletag.cmd.push(function() { googletag.display('div-gpt-ad-1458247671871-1'); }); </script> </div> </div> <div class="subject-areas-container"> <h3>Subject Areas <div id="subjInfo">?</div> <div id="subjInfoText"> <p>For more information about PLOS Subject Areas, click <a href="https://github.com/PLOS/plos-thesaurus/blob/master/README.md" target="_blank" title="Link opens in new window">here</a>.</p> <span class="inline-intro">We want your feedback.</span> Do these Subject Areas make sense for this article? Click the target next to the incorrect Subject Area and let us know. Thanks for your help! </div> </h3> <ul id="subjectList"> <li> <a class="taxo-term" title="Search for articles about Hemorrhagic fever with renal syndrome" href="/plosone/search?filterSubjects=Hemorrhagic+fever+with+renal+syndrome&filterJournals=PLoSONE&q=">Hemorrhagic fever with renal syndrome</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Hemorrhagic fever with renal syndrome"><p class="taxo-explain">Is the Subject Area <strong>"Hemorrhagic fever with renal syndrome"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Machine learning" href="/plosone/search?filterSubjects=Machine+learning&filterJournals=PLoSONE&q=">Machine learning</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Machine learning"><p class="taxo-explain">Is the Subject Area <strong>"Machine learning"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Frailty" href="/plosone/search?filterSubjects=Frailty&filterJournals=PLoSONE&q=">Frailty</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Frailty"><p class="taxo-explain">Is the Subject Area <strong>"Frailty"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Machine learning algorithms" href="/plosone/search?filterSubjects=Machine+learning+algorithms&filterJournals=PLoSONE&q=">Machine learning algorithms</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Machine learning algorithms"><p class="taxo-explain">Is the Subject Area <strong>"Machine learning algorithms"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Algorithms" href="/plosone/search?filterSubjects=Algorithms&filterJournals=PLoSONE&q=">Algorithms</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Algorithms"><p class="taxo-explain">Is the Subject Area <strong>"Algorithms"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Hospitals" href="/plosone/search?filterSubjects=Hospitals&filterJournals=PLoSONE&q=">Hospitals</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Hospitals"><p class="taxo-explain">Is the Subject Area <strong>"Hospitals"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Medical risk factors" href="/plosone/search?filterSubjects=Medical+risk+factors&filterJournals=PLoSONE&q=">Medical risk factors</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Medical risk factors"><p class="taxo-explain">Is the Subject Area <strong>"Medical risk factors"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Decision tree learning" href="/plosone/search?filterSubjects=Decision+tree+learning&filterJournals=PLoSONE&q=">Decision tree learning</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Decision tree learning"><p class="taxo-explain">Is the Subject Area <strong>"Decision tree learning"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> </ul> </div> <div id="subjectErrors"></div> </aside> </div> </main> <footer id="pageftr"> <div class="row"> <div class="block x-small"> <ul class="nav nav-secondary"> <li class="ftr-header"><a href="https://plos.org/our-journals/">Publications</a></li> <li><a href="/plosbiology/" id="ftr-bio">PLOS Biology</a></li> <li><a href="/climate/" id="ftr-climate">PLOS Climate</a></li> <li><a href="/complexsystems/" id="ftr-complex-systems">PLOS Complex Systems</a></li> <li><a href="/ploscompbiol/" id="ftr-compbio">PLOS Computational Biology</a></li> <li><a href="/digitalhealth/" id="ftr-digitalhealth">PLOS Digital Health</a></li> <li><a href="/plosgenetics/" id="ftr-gen">PLOS Genetics</a></li> <li><a href="/globalpublichealth/" id="ftr-globalpublichealth">PLOS Global Public Health</a></li> </ul> </div> <div class="block x-small"> <ul class="nav nav-secondary"> <li class="ftr-header"> </li> <li><a href="/plosmedicine/" id="ftr-med">PLOS Medicine</a></li> <li><a href="/mentalhealth/" id="ftr-mental-health">PLOS Mental Health</a></li> <li><a href="/plosntds/" id="ftr-ntds">PLOS Neglected Tropical Diseases</a></li> <li><a href="/plosone/" id="ftr-one">PLOS One</a></li> <li><a href="/plospathogens/" id="ftr-path">PLOS Pathogens</a></li> <li><a href="/sustainabilitytransformation/" id="ftr-sustainabilitytransformation">PLOS Sustainability and Transformation</a></li> <li><a href="/water/" id="ftr-water">PLOS Water</a></li> </ul> </div> <div class="block xx-small"> <ul class="nav nav-tertiary"> <li> <a href="https://plos.org" id="ftr-home">Home</a> </li> <li> <a href="https://blogs.plos.org" id="ftr-blog">Blogs</a> </li> <li> <a href="https://collections.plos.org/" id="ftr-collections">Collections</a> </li> <li> <a href="mailto:webmaster@plos.org" id="ftr-feedback">Give feedback</a> </li> <li> <a href="/plosone/lockss-manifest" id="ftr-lockss">LOCKSS</a> </li> </ul> </div> <div class="block xx-small"> <ul class="nav nav-primary"> <li><a href="https://plos.org/privacy-policy" id="ftr-privacy">Privacy Policy</a></li> <li><a href="https://plos.org/terms-of-use" id="ftr-terms">Terms of Use</a></li> <li><a href="https://plos.org/advertise/" id="ftr-advertise">Advertise</a></li> <li><a href="https://plos.org/media-inquiries" id="ftr-media">Media Inquiries</a></li> <li><a href="https://plos.org/contact" id="ftr-contact">Contact</a></li> </ul> </div> </div> <div class="row"> <p> <img src="/resource/img/logo-plos-footer.png" alt="PLOS" class="logo-footer"/> <span class="footer-non-profit-statement">PLOS is a nonprofit 501(c)(3) corporation, #C2354500, based in California, US</span> </p> <div class="block"> </div> </div> <script src="/resource/js/global.js" type="text/javascript"></script> </footer> <script type="text/javascript"> var ArticleData = { doi: '10.1371/journal.pone.0279433', title: '<article-title xmlns:mml=\"http://www.w3.org/1998/Math/MathML\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">Prediction of hospital readmission of multimorbid patients using machine learning models<\/article-title>', date: 'Dec 22, 2022' }; </script> <script src="/resource/js/components/show_onscroll.js" type="text/javascript"></script> <script src="/resource/js/components/pagination.js" type="text/javascript"></script> <script src="/resource/js/vendor/spin.js" type="text/javascript"></script> <script src="/resource/js/pages/article.js" type="text/javascript"></script> <script src="/resource/js/pages/article_references.js" type="text/javascript"></script> <script src="/resource/js/pages/article_sidebar.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.dropdown.js" type="text/javascript"></script> <script src="/resource/js/components/table_open.js" type="text/javascript"></script> <script src="/resource/js/components/figshare.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.panzoom.min.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.mousewheel.js" type="text/javascript"></script> <script src="/resource/js/components/lightbox.js" type="text/javascript"></script> <script src="/resource/js/pages/article_body.js" type="text/javascript"></script>    <script type="text/x-mathjax-config"> MathJax.Hub.Config({ "HTML-CSS": { scale: 100, availableFonts: ["STIX","TeX"], preferredFont: "STIX", webFont: "STIX-Web", linebreaks: { automatic: false } }, jax: ["input/MathML", "output/HTML-CSS"] }); </script> <script type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.1/MathJax.js?config=MML_HTMLorMML"></script> <div class="reveal-modal-bg"></div> </body> </html>