Development and Validation of the RCOS Prognostic Index: A Bedside Multivariable Logistic Regression Model to Predict Hypoxaemia or Death in Patients with SARS-CoV-2 Infection

This article has been Reviewed by the following groups

Read the full article See related articles

Discuss this preprint

Start a discussion What are Sciety discussions?

Abstract

Introduction. Previous COVID-19 prognostic models have been developed in hospital settings and are not applicable to COVID-19 cases in the general population. There is an urgent need for prognostic scores aimed to identify patients at high risk of complications at the time of COVID-19 diagnosis. Methods. The RDT COVID-19 Observational Study (RCOS) collected clinical data from patients with COVID-19 admitted regardless of the severity of their symptoms in a general hospital in India. We aimed to develop and validate a simple bedside prognostic score to predict the risk of hypoxaemia or death. Results. 4035 patients were included in the development cohort and 2046 in the validation cohort. The primary outcome occurred in 961 (23.8%) and 548 (26.8%) patients in the development and validation cohorts, respectively. The final model included 12 variables: age, systolic blood pressure, heart rate, respiratory rate, aspartate transaminase, lactate dehydrogenase, urea, C-reactive protein, sodium, lymphocyte count, neutrophil count, and neutrophil/lymphocyte ratio. In the validation cohort, the area under the receiver operating characteristic curve (AUROCC) was 0.907 (95% CI, 0.892–0.922), and the Brier Score was 0.098. The decision curve analysis showed good clinical utility in hypothetical scenarios where the admission of patients was decided according to the prognostic index. When the prognostic index was used to predict mortality in the validation cohort, the AUROCC was 0.947 (95% CI, 0.925–0.97) and the Brier score was 0.0188. Conclusions. The RCOS prognostic index could help improve the decision making in the current COVID-19 pandemic, especially in resource-limited settings with poor healthcare infrastructure such as India. However, implementation in other settings is needed to cross-validate and verify our findings.

Article activity feed

  1. SciScore for 10.1101/2021.03.29.21254393: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    Institutional Review Board StatementIRB: The associated Ethics Committee approved the study and waived the need for informed consent.
    Consent: The associated Ethics Committee approved the study and waived the need for informed consent.
    Randomizationnot detected.
    Blindingnot detected.
    Power Analysisnot detected.
    Sex as a biological variablenot detected.

    Table 2: Resources

    No key resources detected.


    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    Strengths and limitations: In COVID-19 cases, hypoxemia usually appears within five to ten days of symptoms [26–28]. In our study, patients were admitted regardless of the severity of symptoms and were not discharged before ten days passed from symptom onset. In the development cohort, 23.8% of the patients developed hypoxaemia or died, which is similar to the proportion of severe cases found in a large cohort from China [2]. This suggests that the model was developed in a population representative of COVID-19 in the community. However, the validation cohort had a larger proportion of patients with hypoxaemia than the development cohort, and both predicted and observed risk were higher than expected in some of the risk groups, suggesting a selection of more severe cases in the validation cohort as the clinical pressure to be admitted increased because the number of COVID-19 cases spiked in the region during the study period. When implementing the prognostic index in populations with lower (e.g. primary health centre) or higher (e.g. emergency department) expected risk, the use of risk groups may overestimate (primary health centre) or underestimate (emergency department) the real risk of complications. Although classifying patients in risk groups can still be useful as an initial reference, our results suggest that users of the prognostic index should try to estimate the predicted probability of the outcome in their settings. The prognostic model was not developed to predict ...

    Results from TrialIdentifier: No clinical trial numbers were referenced.


    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


    Results from JetFighter: We did not find any issues relating to colormaps.


    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.