Comparison of Predictive Validity of the ROX Index and the m-ROX Index for the HFNC Outcome in ICU Patients with AHRF


DOI:
https://doi.org/10.61705/yr0jtg12Keywords:
high flow nasal cannula, acute hypoxia respiratory failure, ROX index, m-ROX indexAbstract
Objective: To compare the predictive validity of ROX index and m-ROX index for high-flow nasal cannula (HFNC) outcomes in patients with acute hypoxia respiratory failure (AHRF) admitted to the intensive care unit (ICU).
Methods: All adult patients who received HFNC therapy due to AHRF at Beijing Shijitan Hospital's ICUs from May 2022 to May 2024 were analyzed. Heart rate, peripheral oxygen saturation, fraction of inspiration oxygen, and respiratory rate were collected at 0.5 hours, 6 hours, 12 hours, 18 hours, and 24 hours after HFNC initiation through electronic medical records to calculate the ROX index and m-ROX index. Predictive validity of the two indices to HFNC outcome were analyzed by ROC curve , and the diagnostic efficacy in actual clinical application was compared through clinical decision curve analysis(DCA).
Results:
After 1:1 PSM matching, a total of 100 patients were included in the analysis, with 50 patients in the succeed group and 50 in the failed group. ROC analysis revealed that the predictive validity of both the ROX index( AUROC 0.76, cut-off value 5.7,sensitivity 0.88, specificity 0.57) and m-ROX index ( AUROC 0.79, cut-off value 7,sensitivity 0.78, specificity 0.77) after 6 hour of HFNC initiation were acceptable, and improved over time. No statistical difference in predictive validity between the two indices(p>0.05). The cut-off value for the ROX index varied at subsequent monitoring points(H12: 6.9; H18: 6.25; H24: 6.25), whereas the cut-off values for the m-ROX index remained relatively stable(H12: 7; H18: 7; H24: 6).
DCA analysis demonstrated that both indices exhibited strong predictive validity within the threshold probability range of 0.3 to 1.0. At a threshold probability of 0.6, the m-ROX index displayed equivalent predictive validity to that of the ROX index.
Conclusions: both ROX index and m-ROX index had strong predictive validity for the HFNC outcome.
References
Crimi C, Pierucci P, Renda T, Pisani L, Carlucci A. High-Flow Nasal Cannula and COVID-19: A Clinical Review. Respir Care. 2022 Feb;67(2):227-240.
Frat JP, Ragot S, Girault C, Perbet S, Prat G, Boulain T, et al. Effect of non-invasive oxygenation strategies in immunocompromised patients with severe acute respiratory failure: a post-hoc analysis of a randomised trial. Lancet Respir Med. 2016 Aug;4(8):646-652.
Frat JP, Thille AW, Mercat A, Girault C, Ragot S, Perbet S, et al. High-flow oxygen through nasal cannula in acute hypoxemic respiratory failure. N Engl J Med. 2015 Jun 4;372(23):2185-96.
Roca O, Messika J, Caralt B, García-de-Acilu M, Sztrymf B, Ricard JD, et al. Predicting success of high-flow nasal cannula in pneumonia patients with hypoxemic respiratory failure: The utility of the ROX index. J Crit Care. 2016 Oct;35:200-5.
Roca O, Caralt B, Messika J, Samper M, Sztrymf B, Hernández G, et al. An Index Combining Respiratory Rate and Oxygenation to Predict Outcome of Nasal High-Flow Therapy. Am J Respir Crit Care Med. 2019 Jun 1;199(11):1368-1376. 6.Zhou X, Liu J, Pan J, Xu Z, Xu J. The ROX index as a predictor of high-flow nasal cannula outcome in pneumonia patients with acute hypoxemic respiratory failure: a systematic review and meta-analysis. BMC Pulm Med. 2022 Apr 1;22(1):121.
Junhai Z, Jing Y, Beibei C, Li L. The value of ROX index in predicting the outcome of high flow nasal cannula: a systematic review and meta-analysis. Respir Res. 2022 Feb 17;23(1):33.
Maslove DM, Dubin JA, Shrivats A, Lee J. Errors, Omissions, and Outliers in Hourly Vital Signs Measurements in Intensive Care. Crit Care Med. 2016 Nov;44(11):e1021-e1030.
Siebenmann C, Lundby C. Regulation of cardiac output in hypoxia. Scand J Med Sci Sports. 2015 Dec;25 Suppl 4:53-9.
Bhavani SV, Robichaux C, Verhoef PA, Churpek MM, Coopersmith CM. Using Trajectories of Bedside Vital Signs to Identify COVID-19 Subphenotypes. Chest. 2024 Mar;165(3):529-539.
Bhavani SV, Semler M, Qian ET, Verhoef PA, Robichaux C, Churpek MM, et al. Development and validation of novel sepsis subphenotypes using trajectories of vital signs. Intensive Care Med. 2022 Nov;48(11):1582-1592.
Blackburn HN, Clark MT, Moorman JR, Lake DE, Calland JF. Identifying the low risk patient in surgical intensive and intermediate care units using continuous monitoring. Surgery. 2018 Apr;163(4):811-818.
Goh KJ, Chai HZ, Ong TH, Sewa DW, Phua GC, Tan QL. Early prediction of high flow nasal cannula therapy outcomes using a modified ROX index incorporating heart rate. J Intensive Care. 2020 Jun 22;8:41.
Ruangsomboon O, Jirathanavichai S, Phanprasert N, Puchongmart C, Boonmee P, Thirawattanasoot N, et al. Ratio of Oxygen Saturation to Inspired Oxygen, ROX Index, Modified ROX Index to Predict High Flow Cannula Success in COVID-19 Patients: Multicenter Validation Study. West J Emerg Med. 2023 Apr 28;24(3):511-521.
Austin PC. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate Behav Res. 2011;46(3):399–424.
Linden A, Samuels SJ. Using balance statistics to determine the optimal number of controls in matching studies. J Eval Clin Pract. 2013;19(5):968–975.
Hamahata N, Pinsky MR. Heart-Lung Interactions. Semin Respir Crit Care Med. 2023 Oct;44(5):650-660.
Desai A, Aliberti S, Amati F, Stainer A, Voza A. Cardiovascular Complications in Community-Acquired Pneumonia. Microorganisms. 2022 Nov 2;10(11):2177.
Dandel M. Heart-lung interactions in COVID-19: prognostic impact and usefulness of bedside echocardiography for monitoring of the right ventricle involvement. Heart Fail Rev. 2022 Jul;27(4):1325-1339.
Lee YS, Chang SW, Sim JK, Kim S, Kim JH. An Integrated Model including the ROX Index to Predict the Success of High-Flow Nasal Cannula Use after Planned Extubation: A Retrospective Observational Cohort Study. J Clin Med. 2021 Aug;10(16):3513.
Rodriguez M, Thille AW, Boissier F, Veinstein A, Chatellier D, Robert R, et al. Predictors of successful separation from high-flow nasal oxygen therapy in patients with acute respiratory failure: a retrospective mono-center study. Ann Intensive Care. 2019 Sep 11;9(1):101.
Girault C, Bubenheim M, Boyer D, Declercq PL, Schnell G, Gouin P, et al. ROX index performance to predict high-flow nasal oxygen outcome in Covid-19 related hypoxemic acute respiratory failure. Ann Intensive Care. 2024 Jan 18;14(1):13.
Additional Files
Published
Issue
Section
License
Copyright (c) 2025 International Journal of Medical Research

This work is licensed under a Creative Commons Attribution 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJMR open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.