Real World Effectiveness of COVID-19 mRNA Vaccines against Hospitalizations and Deaths in the United States

  1. Farhaan S. Vahidy
  2. Lauen Pischel
  3. Mauricio E Tano
  4. Alan P Pan
  5. Marc L Boom
  6. Henry Dirk Sostman
  7. Khurram Nasir
  8. Saad B Omer

Reviewed by

Read the full article See related articles

Discuss this preprint

Start a discussion What are Sciety discussions?

Listed in

Log in to save this article

Abstract

The authors have withdrawn this manuscript because they are continuing to review the analytical methods utilized in this iteration of the work and, as of yet, do not have adequate confidence in their reproducibility. Therefore, the authors do not wish this work to be cited as reference for the project. If you have any questions, please contact the corresponding author.

Article activity feed

  1. ScreenIT

    SciScore for 10.1101/2021.04.21.21255873: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    EthicsIRB: The CURATOR is approved by HM institutional review board (PRO 00025445:1, dated: April 13, 2020).
    Sex as a biological variablenot detected.
    Randomizationnot detected.
    Blindingnot detected.
    Power Analysisnot detected.

    Table 2: Resources

    Software and Algorithms
    SentencesResources
    Python packages lifeline version 0.25.10 were used for time-to-event analyses.
    Python
    suggested: (IPython, RRID:SCR_001658)

    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).

    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    Limitations of this study include its observational design, as there may have been some differences in testing behavior between those who were unvaccinated, partially vaccinated and fully vaccinated that are unaccounted for in this analysis. For example, there may have been differences in health-seeking behavior between these groups or different thresholds to test for SARS-CoV-2 amongst clinicians. However, it is unlikely there were large differences in hospitalization rates based on behavior alone. Across the pandemic timeline, the criteria for hospitalization have been consistently based on risk stratification by evaluation of the severity of symptoms, comorbidities, diagnostic findings and pulse oximetry. Second, as this is an observational study, there may be some residual unmeasured confounding, however, this is unlikely to alter the overall interpretation. It is also possible that certain individuals in the established cohort may have been tested and/or hospitalized elsewhere in the region. However, our healthcare system has a relatively high rate of patient retention. For example, in the overall tested cohort in CURATOR, > 95% have had at least one prior healthcare system encounter. Overall the vaccine effectiveness seen in this study was similar to the vaccine efficacy of clinical trials, which is reassuring. Finally, this study only examined two of the three vaccines currently approved for use in the US due to the timing of the study. It will be important going forwa...

    Results from TrialIdentifier: No clinical trial numbers were referenced.

    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.

    Results from JetFighter: We did not find any issues relating to colormaps.

    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.

  2. Version published to 10.1101/2021.04.21.21255873 on medRxiv