An Externally Validated Dynamic Nomogram for Predicting Unfavorable Prognosis in Patients With Aneurysmal Subarachnoid Hemorrhage

Background: Aneurysmal subarachnoid hemorrhage (aSAH) leads to severe disability and functional dependence. However, no reliable method exists to predict the clinical prognosis after aSAH. Thus, this study aimed to develop a web-based dynamic nomogram to precisely evaluate the risk of poor outcomes...

Full description

Bibliographic Details
Main Authors: Ping Hu, Yang Xu, Yangfan Liu, Yuntao Li, Liguo Ye, Si Zhang, Xinyi Zhu, Yangzhi Qi, Huikai Zhang, Qian Sun, Yixuan Wang, Gang Deng, Qianxue Chen
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-08-01
Series:Frontiers in Neurology
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fneur.2021.683051/full
id doaj-fc4ee42b6ebd4e3e88743d27eff543c9
record_format Article
collection DOAJ
language English
format Article
sources DOAJ
author Ping Hu
Yang Xu
Yangfan Liu
Yuntao Li
Liguo Ye
Si Zhang
Xinyi Zhu
Yangzhi Qi
Huikai Zhang
Qian Sun
Yixuan Wang
Gang Deng
Qianxue Chen
spellingShingle Ping Hu
Yang Xu
Yangfan Liu
Yuntao Li
Liguo Ye
Si Zhang
Xinyi Zhu
Yangzhi Qi
Huikai Zhang
Qian Sun
Yixuan Wang
Gang Deng
Qianxue Chen
An Externally Validated Dynamic Nomogram for Predicting Unfavorable Prognosis in Patients With Aneurysmal Subarachnoid Hemorrhage
Frontiers in Neurology
aneurysmal subarachnoid hemorrhage
unfavorable prognosis
LASSO regression
multivariable logistic regression
dynamic nomogram
external validation
author_facet Ping Hu
Yang Xu
Yangfan Liu
Yuntao Li
Liguo Ye
Si Zhang
Xinyi Zhu
Yangzhi Qi
Huikai Zhang
Qian Sun
Yixuan Wang
Gang Deng
Qianxue Chen
author_sort Ping Hu
title An Externally Validated Dynamic Nomogram for Predicting Unfavorable Prognosis in Patients With Aneurysmal Subarachnoid Hemorrhage
title_short An Externally Validated Dynamic Nomogram for Predicting Unfavorable Prognosis in Patients With Aneurysmal Subarachnoid Hemorrhage
title_full An Externally Validated Dynamic Nomogram for Predicting Unfavorable Prognosis in Patients With Aneurysmal Subarachnoid Hemorrhage
title_fullStr An Externally Validated Dynamic Nomogram for Predicting Unfavorable Prognosis in Patients With Aneurysmal Subarachnoid Hemorrhage
title_full_unstemmed An Externally Validated Dynamic Nomogram for Predicting Unfavorable Prognosis in Patients With Aneurysmal Subarachnoid Hemorrhage
title_sort externally validated dynamic nomogram for predicting unfavorable prognosis in patients with aneurysmal subarachnoid hemorrhage
publisher Frontiers Media S.A.
series Frontiers in Neurology
issn 1664-2295
publishDate 2021-08-01
description Background: Aneurysmal subarachnoid hemorrhage (aSAH) leads to severe disability and functional dependence. However, no reliable method exists to predict the clinical prognosis after aSAH. Thus, this study aimed to develop a web-based dynamic nomogram to precisely evaluate the risk of poor outcomes in patients with aSAH.Methods: Clinical patient data were retrospectively analyzed at two medical centers. One center with 126 patients was used to develop the model. Least absolute shrinkage and selection operator (LASSO) analysis was used to select the optimal variables. Multivariable logistic regression was applied to identify independent prognostic factors and construct a nomogram based on the selected variables. The C-index and Hosmer–Lemeshow p-value and Brier score was used to reflect the discrimination and calibration capacities of the model. Receiver operating characteristic curve and calibration curve (1,000 bootstrap resamples) were generated for internal validation, while another center with 84 patients was used to validate the model externally. Decision curve analysis (DCA) and clinical impact curves (CICs) were used to evaluate the clinical usefulness of the nomogram.Results: Unfavorable prognosis was observed in 46 (37%) patients in the training cohort and 24 (29%) patients in the external validation cohort. The independent prognostic factors of the nomogram, including neutrophil-to-lymphocyte ratio (NLR) (p = 0.005), World Federation of Neurosurgical Societies (WFNS) grade (p = 0.002), and delayed cerebral ischemia (DCI) (p = 0.0003), were identified using LASSO and multivariable logistic regression. A dynamic nomogram (https://hu-ping.shinyapps.io/DynNomapp/) was developed. The nomogram model demonstrated excellent discrimination, with a bias-corrected C-index of 0.85, and calibration capacities (Hosmer–Lemeshow p-value, 0.412; Brier score, 0.12) in the training cohort. Application of the model to the external validation cohort yielded a C-index of 0.84 and a Brier score of 0.13. Both DCA and CIC showed a superior overall net benefit over the entire range of threshold probabilities.Conclusion: This study identified that NLR on admission, WFNS grade, and DCI independently predicted unfavorable prognosis in patients with aSAH. These factors were used to develop a web-based dynamic nomogram application to calculate the precise probability of a poor patient outcome. This tool will benefit personalized treatment and patient management and help neurosurgeons make better clinical decisions.
topic aneurysmal subarachnoid hemorrhage
unfavorable prognosis
LASSO regression
multivariable logistic regression
dynamic nomogram
external validation
url https://www.frontiersin.org/articles/10.3389/fneur.2021.683051/full
work_keys_str_mv AT pinghu anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT yangxu anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT yangfanliu anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT yuntaoli anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT liguoye anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT sizhang anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT xinyizhu anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT yangzhiqi anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT huikaizhang anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT qiansun anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT yixuanwang anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT gangdeng anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT qianxuechen anexternallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT pinghu externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT yangxu externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT yangfanliu externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT yuntaoli externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT liguoye externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT sizhang externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT xinyizhu externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT yangzhiqi externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT huikaizhang externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT qiansun externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT yixuanwang externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT gangdeng externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
AT qianxuechen externallyvalidateddynamicnomogramforpredictingunfavorableprognosisinpatientswithaneurysmalsubarachnoidhemorrhage
_version_ 1721196062576738304
spelling doaj-fc4ee42b6ebd4e3e88743d27eff543c92021-08-26T06:15:14ZengFrontiers Media S.A.Frontiers in Neurology1664-22952021-08-011210.3389/fneur.2021.683051683051An Externally Validated Dynamic Nomogram for Predicting Unfavorable Prognosis in Patients With Aneurysmal Subarachnoid HemorrhagePing Hu0Yang Xu1Yangfan Liu2Yuntao Li3Liguo Ye4Si Zhang5Xinyi Zhu6Yangzhi Qi7Huikai Zhang8Qian Sun9Yixuan Wang10Gang Deng11Qianxue Chen12Department of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaDepartment of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaDepartment of Neurosurgery, the Affiliated Hospital of Panzhihua University, Panzhihua, ChinaDepartment of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaDepartment of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaDepartment of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaDepartment of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaDepartment of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaDepartment of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaDepartment of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaDepartment of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaDepartment of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaDepartment of Neurosurgery, Renmin Hospital of Wuhan University, Wuhan, ChinaBackground: Aneurysmal subarachnoid hemorrhage (aSAH) leads to severe disability and functional dependence. However, no reliable method exists to predict the clinical prognosis after aSAH. Thus, this study aimed to develop a web-based dynamic nomogram to precisely evaluate the risk of poor outcomes in patients with aSAH.Methods: Clinical patient data were retrospectively analyzed at two medical centers. One center with 126 patients was used to develop the model. Least absolute shrinkage and selection operator (LASSO) analysis was used to select the optimal variables. Multivariable logistic regression was applied to identify independent prognostic factors and construct a nomogram based on the selected variables. The C-index and Hosmer–Lemeshow p-value and Brier score was used to reflect the discrimination and calibration capacities of the model. Receiver operating characteristic curve and calibration curve (1,000 bootstrap resamples) were generated for internal validation, while another center with 84 patients was used to validate the model externally. Decision curve analysis (DCA) and clinical impact curves (CICs) were used to evaluate the clinical usefulness of the nomogram.Results: Unfavorable prognosis was observed in 46 (37%) patients in the training cohort and 24 (29%) patients in the external validation cohort. The independent prognostic factors of the nomogram, including neutrophil-to-lymphocyte ratio (NLR) (p = 0.005), World Federation of Neurosurgical Societies (WFNS) grade (p = 0.002), and delayed cerebral ischemia (DCI) (p = 0.0003), were identified using LASSO and multivariable logistic regression. A dynamic nomogram (https://hu-ping.shinyapps.io/DynNomapp/) was developed. The nomogram model demonstrated excellent discrimination, with a bias-corrected C-index of 0.85, and calibration capacities (Hosmer–Lemeshow p-value, 0.412; Brier score, 0.12) in the training cohort. Application of the model to the external validation cohort yielded a C-index of 0.84 and a Brier score of 0.13. Both DCA and CIC showed a superior overall net benefit over the entire range of threshold probabilities.Conclusion: This study identified that NLR on admission, WFNS grade, and DCI independently predicted unfavorable prognosis in patients with aSAH. These factors were used to develop a web-based dynamic nomogram application to calculate the precise probability of a poor patient outcome. This tool will benefit personalized treatment and patient management and help neurosurgeons make better clinical decisions.https://www.frontiersin.org/articles/10.3389/fneur.2021.683051/fullaneurysmal subarachnoid hemorrhageunfavorable prognosisLASSO regressionmultivariable logistic regressiondynamic nomogramexternal validation