Abstract
Early detection of pediatric severe sepsis is necessary in order to administer effective treatment. In this study, we assessed the efficacy of a machine-learning-based prediction algorithm applied to electronic healthcare record (EHR) data for the prediction of severe sepsis onset. The resulting prediction performance was compared with the Pediatric Logistic Organ Dysfunction score (PELOD-2) and pediatric Systemic Inflammatory Response Syndrome score (SIRS) using cross-validation and pairwise t-tests. EHR data were collected from a retrospective set of de-identified pediatric inpatient and emergency encounters drawn from the University of California San Francisco (UCSF) Medical Center, with encounter dates between June 2011 and March 2016. Patients (n = 11,127) were 2-17 years of age and 103 [0.93%] were labeled severely septic. In four-fold cross-validation evaluations, the machine learning algorithm achieved an AUROC of 0.912 for discrimination between severely septic and control pediatric patients at onset and AUROC of 0.727 four hours before onset. Under the same measure, the prediction algorithm also significantly outperformed PELOD-2 (p < 0.05) and SIRS (p < 0.05) in the prediction of severe sepsis four hours before onset. This machine learning algorithm has the potential to deliver high-performance severe sepsis detection and prediction for pediatric inpatients.
List of Abbreviations
- AUROC
- area under the receiver operating characteristic curve
- CV
- cross-validation
- DOR
- diagnostic odds ratio
- EHR
- electronic health record
- ICD-9
- international classification of diseases, 9th revision
- IQR
- interquartile range
- ML
- machine learning
- MLA
- machine learning algorithm
- PELOD
- Pediatric Logistic Organ Dysfunction score
- ROC
- receiver operating characteristic
- SE
- standard error
- SIRS
- Systemic Inflammatory Response Syndrome
- UCSF
- University of California San Francisco