1. Our take

    in this study of 13,109 healthcare workers in the UK, available as a preprint and thus not yet peer-reviewed, 13,109 healthcare workers in the UK followed from April 2020 through February 2021, a single dose of either the Pfizer-BioNTech or the Oxford-AstraZeneca vaccine conferred an estimated 67% protection against symptomatic SARS-CoV-2 infection beginning 14 days after vaccination, and there were no cases 14 days after two doses of either vaccine. Evidence of prior infection from a positive antibody test was associated with an apparent 98% protection, though it is unclear how often HCWs received antibody testing. No differences were observed in apparent protection (either from vaccination or prior infection) when comparing the B.1.1.7 variant against non-B.1.1.7 lineages. Rates of SARS-CoV-2 infection increased during the first 14 days after infection, but this time was not included in analyses.

    Study design


    Study population and setting

    This observational study assessed protection from symptomatic PCR-confirmed SARS-CoV-2 infection conferred by vaccination and/or prior infection among 13,109 healthcare workers (HCWs, 74% female, median age 39 years) in a hospital network in the UK from April 23, 2020 to February 28, 2021. HCWs were classified by their vaccination status (1 dose vs. 2 doses of either the Pfizer-BioNTech or Oxford-AstraZeneca vaccines) and antibody status (any previous positive test for anti-spike IgG antibodies). Person-time was classified into five groups: 1) unvaccinated, seronegative; 2) unvaccinated, seropositive; 3) vaccinated once, seronegative; 4) vaccinated twice, seronegative; and 5) vaccinated once or twice, seropositive. HCWs could contribute person-time at risk to multiple exposure groups. Vaccinated follow-up time began 14 days after vaccination, while seropositive follow-up time began 60 days after initial positive antibody result. Asymptomatic HCWs were offered voluntary PCR testing for SARS-CoV-2 infection every two weeks and antibody testing every two months beginning April 23, 2020. Risks of infection were compared across vaccination and antibody status, and were compared between the B.1.1.7 variant and non-B.1.1.7 variants. The B.1.1.7 variant was identified via PCR test results indicative of S gene target failure (SGTF) as of November 16, 2020; all positive samples starting on December 1, 2020 were sequenced to identify the viral lineage. The authors used Poisson regression to test for differences in incidence rates in each exposure group, adjusted for month, age, sex, ethnicity, occupational role, amount of patient contact, and whether the HCW worked in a non-ICU ward caring for COVID-19 patients. Sensitivity analyses were conducted to test for differences by vaccine type, by time since vaccination, by SGTF, and by B.1.1.7 vs. non-B.1.1.7 lineage.

    Summary of main findings

    A total of 13,109 healthcare workers (HCWs) contributed 2,835,260 person-days of time to the study. Over the study period, 1,273 HCWs tested positive for IgG anti-spike antibodies; 8,285 HCWs received the Pfizer-BioNTech vaccine and 2,738 received the Oxford-AstraZeneca vaccine. There was an increase in the incidence rate above baseline levels, even after adjustment, during the first 14 days after vaccination; these cases were excluded from analysis. There were 294 symptomatic infections among unvaccinated seronegative HCWs during follow-up, 32 among vaccinated HCWs (31/32 were previously seronegative), and 1 in an unvaccinated seropositive HCW. Relative to unvaccinated seronegative HCWs, the adjusted incidence rate ratio (IRR) for seropositivity was 0.02 (95% CI: <0.01 to 0.18). Among previously seronegative HCWs, the adjusted IRR for a single vaccine dose was 0.33 (95% CI: 0.21 to 0.52), and there were no infections among HCWs who had received a second dose. There were 16 COVID-19 hospitalizations among unvaccinated seronegative HCWs, and no hospitalizations among vaccinated HCWs. When considering any SARS-CoV-2 infection regardless of symptoms, the IRR for seropositivity was 0.15 (95% CI: 0.08 to 0.26); among seronegative HCWs, the IRR was 0.36 (0.26 to 0.50) for the first vaccine dose and 0.10 (95% CI: 0.02 to 0.38) for the second dose. There were no statistically significant differences in incidence by vaccine type. Viral loads were highest among unvaccinated previously seronegative cases, followed by vaccinated previously seronegative cases, and lowest among unvaccinated seropositive cases. There was no evidence that SGTF or B.1.1.7 lineage altered the incidence rate among seropositive or vaccinated HCWs, though the confidence intervals were wide.

    Study strengths

    Frequent testing of HCWs allowed consideration of COVID-19 incidence across person time for a wide range of exposures (defined by antibody and vaccination status). A high proportion of infections was assessed for SGTF and/or sequenced to determine viral lineage.


    Follow-up time after vaccination, particularly the second vaccination, was short and few events were observed. There were increases in incidence during the first two weeks after vaccination, but this person-time and these cases were not included in analyses: if these HCWs were systematically different from those remaining in the risk set, the ensuing selection bias would overestimate vaccine protection. Any prior positive antibody test was used as a proxy for previous infection, which is subject to several limitations. First, the frequency of testing among HCWs was not reported, and it appears that all person-time before a positive antibody test was classified as seronegative; thus, misclassification of person-time is likely and incidence among seropositive HCWs may be underestimated. If HCWs with prior symptoms were more likely to seek serological testing, and if asymptomatic infection confers less protection against re-infection, then this issue would be exacerbated. On the other hand, false positive results are not uncommon even with highly specific assays in low-prevalence populations, which would bias estimates of incidence among seropositive HCWs in the other direction. HCWs with positive PCR results for SARS-CoV-2 infection were removed from all risk sets; it is not clear why these events were not used as a better indicator of prior infection. Seropositive and vaccinated HCWs were less likely to be tested for SARS-CoV-2 infection, which may have underestimated incidence rates of asymptomatic infection in those groups.

    Value added

    This study took advantage of frequent PCR and serology testing among HCWs in an environment of high transmission to directly compare SARS-CoV-2 incidence rates by vaccination and antibody status, and was able to compare estimates of protection against the B.1.1.7 variant vs. non-B.1.1.7 lineages.

    Read the original source
    Was this evaluation helpful?
  2. SciScore for 10.1101/2021.03.09.21253218: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    Institutional Review Board Statementnot detected.
    Randomizationnot detected.
    Blindingnot detected.
    Power Analysisnot detected.
    Sex as a biological variablenot detected.

    Table 2: Resources

    Laboratory assays: Antibody status was determined using an anti-trimeric spike IgG ELISA39 using an 8 million units threshold to determine antibody-positivity.
    anti-trimeric spike IgG
    suggested: None

    Results from OddPub: Thank you for sharing your data.

    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    One study limitation is that staff working in roles more likely to be exposed to SARS-CoV-2 were initially prioritised for vaccination; these staff were also at the greatest risk of occupationally-acquired SARS-CoV-2 infection. We adjusted for this by including working in a Covid ward and staff roles, but incomplete adjustment could lead to under-estimation of vaccine efficacy. Similarly, vaccinated staff were potentially more likely to be current employees than unvaccinated staff; if unvaccinated seronegative staff left employment this would potentially lead to under-ascertainment of infection in this group. We address this by only including staff using testing and/or vaccination services in the last six months of the study. Testing rates were lower in seropositive HCWs and to a lesser extent following vaccination, leading to under-ascertainment of PCR-positive results in these groups; however, we have previously demonstrated the impact of this is relatively small.2 Other limitations include limited power to detect differences in efficacy between vaccines. We were also unable to sequence all PCR-positives, in particular because those with higher Ct values are less likely to generate high-quality sequences, and some samples were not stored, including those processed by community testing facilities. Similar studies will be needed to assess the vaccine effectiveness against other, novel emerging SARS-CoV-2 lineages. Finally, this is a study of HCWs of working age, so findings m...

    Results from TrialIdentifier: No clinical trial numbers were referenced.

    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.

    Results from JetFighter: We did not find any issues relating to colormaps.

    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.

    Read the original source
    Was this evaluation helpful?