Evaluation of SARS-CoV-2 neutralization assays for antibody monitoring in natural infection and vaccine trials

This article has been Reviewed by the following groups

Read the full article See related articles

Abstract

Determinants of protective immunity against SARS-CoV-2 infection require the development of well-standardized, reproducible antibody assays to be utilized in concert with clinical trials to establish correlates of risk and protection. This need has led to the appearance of a variety of neutralization assays used by different laboratories and companies. Using plasma samples from COVID-19 convalescent individuals with mild-to-moderate disease from a localized outbreak in a single region of the western US, we compared three platforms for SARS-CoV-2 neutralization: assay with live SARS-CoV-2, pseudovirus assay utilizing lentiviral (LV) and vesicular stomatitis virus (VSV) packaging, and a surrogate ELISA test. Vero, Vero E6, HEK293T cells expressing human angiotensin converting enzyme 2 (hACE2), and TZM-bl cells expressing hACE2 and transmembrane serine protease 2 (TMPRSS2) were evaluated. Live-virus and LV-pseudovirus assay with HEK293T cells showed similar geometric mean titers (GMTs) ranging 141–178, but VSV-pseudovirus assay yielded significantly higher GMT (310 95%CI 211-454; p < 0.001). Fifty percent neutralizing dilution (ND50) titers from live-virus and all pseudovirus assay readouts were highly correlated (Pearson r = 0.81–0.89). ND50 titers positively correlated with plasma concentration of IgG against SARS-CoV-2 spike and receptor binding domain (RBD) ( r = 0.63–0.89), but moderately correlated with nucleoprotein IgG ( r = 0.46-0.73). There was a moderate positive correlation between age and spike (Spearman's rho=0.37, p=0.02), RBD (rho=0.39, p=0.013) and nucleoprotein IgG (rho=0.45, p=0.003). ND80 showed stronger correlation with age than ND50 (ND80 rho=0.51 (p=0.001), ND50 rho=0.28 (p=0.075)). Our data demonstrate high concordance between cell-based assays with live and pseudotyped virions.

Article activity feed

  1. SciScore for 10.1101/2020.12.07.20245431: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    Institutional Review Board StatementConsent: Selected volunteers were invited for study participation in May 2020 and sent an electronic consent statement.
    IRB: This study was approved by the Fred Hutch Institutional Review Board and all study materials were provided in both English and Spanish
    RandomizationIn the first phase, study volunteers were randomly selected for participation after stratification by ZIP code, and within ZIP code, age, gender and race/ethnicity.
    Blindingnot detected.
    Power Analysisnot detected.
    Sex as a biological variablenot detected.
    Cell Line Authenticationnot detected.

    Table 2: Resources

    Antibodies
    SentencesResources
    The assay is a chemiluminescent microparticle immunoassay that measures IgG antibodies to the SARS-CoV-2 nucleocapsid protein.
    SARS-CoV-2 nucleocapsid protein .
    suggested: None
    Experimental Models: Cell Lines
    SentencesResources
    Protein antigens: A recombinant form of a synthetic construct (SARS_CoV_2_ectoCSPP (26); GenBank: QJE37812.1) of the spike (S) glycoprotein from SARS-CoV-2 Wuhan-Hu-1 was produced in human HEK293 cells (FreeStyle™ 293-F Cells, ThermoFisher, Waltham, MA) using a lentivirus expression system (27) and purified by nickel affinity and size-exclusion chromatography.
    HEK293
    suggested: RRID:CVCL_6642)
    Twenty-four hours prior infection with VSV(G*ΔG-luciferase), 293T cells were transfected with pcDNA-WuhanCoV-S-D19.
    293T
    suggested: None
    Pseudovirions were produced in HEK 293T/17 cells (catalog number CRL-11268; ATCC) by transfection using Fugene 6 (catalog number E2692; Promega).
    HEK 293T/17
    suggested: ATCC Cat# CRL-11268, RRID:CVCL_1926)
    Vero E6 cells were seeded at 2×104 cells/well in a 96-well plate 24 h before the assay.
    Vero E6
    suggested: None
    After incubation, plasma-virus mixture was transferred onto the Vero cells.
    Vero
    suggested: CLS Cat# 605372/p622_VERO, RRID:CVCL_0059)
    s neutralization assays: Neutralization of SARS-CoV-2 Spike-pseudotyped virus was performed by using lentiviral vectors and infection in either HEK 293T cells expressing human ACE2 (293T/ACE2.MF) or TZM-bl cells expressing both ACE2 and TMPRSS2 (TZM-bl/ACE2/TMPRSS2 cells).
    HEK 293T
    suggested: None
    TZM-bl/ACE2/TMPRSS2
    suggested: None
    293T/ACE2 cells pseudovirus assay: For the 293T/ACE2 assay, a pre-titrated dose of virus was incubated with serial 3-fold dilutions of test sample in duplicate in a total volume of 150 ul for 1 hr at 37°C in 96-well flat-bottom black/white culture plates.
    293T/ACE2
    suggested: RRID:CVCL_YZ65)
    ACE2/TMPRSS2 TZM-bl cells pseudovirus assay: For the TZM-bl/ACE2/TMPRSS2 assay, a pre-titrated dose of virus was incubated with serial 3-fold dilutions of test sample in duplicate in a total volume of 150 ul for 1 hr at 37°C in 96-well flat-bottom culture plates.
    TZM-bl
    suggested: None
    Software and Algorithms
    SentencesResources
    One aliquot was submitted for Architect SARS-CoV-2 IgG assay (Abbott).
    Abbott
    suggested: (Abbott, RRID:SCR_010477)
    Patient demographic information (sex and age) was extracted from a RedCap survey database.
    RedCap
    suggested: (REDCap, RRID:SCR_003445)

    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    ELISA-based assays have two major limitations: i) inability to account for synergistic action of antibodies targeting different epitopes; and ii) detection only of antibodies that block interaction between RBD and ACE2, thus omitting antibodies that neutralize virus via non-RBD sites on the virus glycoprotein (24, 40). For example, synergistic action of antibodies against RBD and the S2 domain has been reported (41). There are two ways of performing such a surrogate assay: soluble biotinylated ACE2 competing with serum antibodies for binding to immobilized RBD or spike, or an opposite version with soluble RBD and immobilized ACE2 (21). Abe et al. found that an assay with soluble ACE2 and immobilized RBD was more sensitive and yielded ND50 values that correlated with ND50 titers obtained in the classical cell-based PRNT with a coefficient of determination of 0.6. The GenScript assay that we have tested in our study utilizes immobilized ACE2, which likely explains why we were not able to measure ND50 titers for the majority of samples. Of note, samples used by Abe et al. were also collected from mild-to-moderate COVID-19 patients. In conclusion, a surrogate assay can be used cautiously as an alternative to cell-based assays to obtain preliminary qualitative results, to rapidly distinguish between samples with high and low neutralizing potency, and when a cell-based assay is not available or reasonably feasible.

    Results from TrialIdentifier: No clinical trial numbers were referenced.


    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


    Results from JetFighter: We did not find any issues relating to colormaps.


    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.