Development and validation of a population-based risk stratification model for severe COVID-19 in the general population

This article has been Reviewed by the following groups

Read the full article

Abstract

The shortage of recently approved vaccines against the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has highlighted the need for evidence-based tools to prioritize healthcare resources for people at higher risk of severe coronavirus disease (COVID-19). Although age has been identified as the most important risk factor (particularly for mortality), the contribution of underlying comorbidities is often assessed using a pre-defined list of chronic conditions. Furthermore, the count of individual risk factors has limited applicability to population-based “stratify-and-shield” strategies. We aimed to develop and validate a COVID-19 risk stratification system that allows allocating individuals of the general population into four mutually-exclusive risk categories based on multivariate models for severe COVID-19, a composite of hospital admission, transfer to intensive care unit (ICU), and mortality among the general population. The model was developed using clinical, hospital, and epidemiological data from all individuals among the entire population of Catalonia (North-East Spain; 7.5 million people) who experienced a COVID-19 event (i.e., hospitalization, ICU admission, or death due to COVID-19) between March 1 and September 15, 2020, and validated using an independent dataset of 218,329 individuals with COVID-19 confirmed by reverse transcription—polymerase chain reaction (RT-PCR), who were infected after developing the model. No exclusion criteria were defined. The final model included age, sex, a summary measure of the comorbidity burden, the socioeconomic status, and the presence of specific diagnoses potentially associated with severe COVID-19. The validation showed high discrimination capacity, with an area under the curve of the receiving operating characteristics of 0.85 (95% CI 0.85–0.85) for hospital admissions, 0.86 (0.86–0.97) for ICU transfers, and 0.96 (0.96–0.96) for deaths. Our results provide clinicians and policymakers with an evidence-based tool for prioritizing COVID-19 healthcare resources in other population groups aside from those with higher exposure to SARS-CoV-2 and frontline workers.

Article activity feed

  1. SciScore for 10.1101/2021.05.25.21257783: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    NIH rigor criteria are not applicable to paper type.

    Table 2: Resources

    No key resources detected.


    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    This limitation is common among many prediction models proposed for COVID-19 [9]. In summary, the proposed risk stratification model for COVID-19 provides policymakers with evidence-based criteria for prioritizing limited COVID-19 resources, including vaccines, treatments, and tests for preventive screening of the general population. This model can also be used for needs planning (e.g., hospital and ICU beds) and to support clinicians with dynamic risk assessment of newly diagnosed COVID-19 patients. Of note, when prioritizing healthcare resources, other criteria aside from health risk shall be considered, including high exposure to SARS-CoV-2 and the development strategic actions for pandemic containment.

    Results from TrialIdentifier: No clinical trial numbers were referenced.


    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


    Results from JetFighter: We did not find any issues relating to colormaps.


    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    Results from scite Reference Check: We found no unreliable references.


    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.