Analytical and clinical performances of a SARS-CoV-2 S-RBD IgG assay: comparison with neutralization titers

This article has been Reviewed by the following groups

Read the full article See related articles

Abstract

Objectives

SARS-CoV-2 serology presents an important role in several aspects of COVID-19 pandemic. Immunoassays performances have to be accurately evaluated and correlated with neutralizing antibodies. We investigated the analytical and clinical performances of a SARS-CoV-2 RBD IgG assay, automated on a high throughput platform, and the correlation of the antibodies (Ab) levels with the plaque reduction neutralization (PRNT 50 ) Ab titers.

Methods

A series of 546 samples were evaluated by SARS-CoV-2 RBD IgG assay (Snibe diagnostics), including 171 negative and 168 positive SARS-CoV-2 subjects and a further group of 207 subjects of the COVID-19 family clusters follow-up cohort.

Results

Assay imprecision ranged from 3.98 to 12.18% being satisfactory at low and medium levels; linearity was excellent in all the measurement range. Considering specimens collected after 14 days post symptoms onset, overall sensitivity and specificity were 99.0 and 92.5%, respectively. A total of 281 leftover samples results of the PRNT 50 test were available. An elevated correlation was obtained between the SARS-CoV-2 RBD IgG assay and the PRNT 50 titer at univariate ( ρ =0.689) and multivariate ( ρ =0.712) analyses.

Conclusions

SARS-CoV-2 S-RBD IgG assay shows satisfactory analytical and clinical performances, and a strong correlation with sera neutralizing activity.

Article activity feed

  1. SciScore for 10.1101/2021.03.10.21253260: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    Institutional Review Board StatementIRB: The study protocol (number 23307) was approved by the Ethics Committee of the University-Hospital, Padova.
    Consent: All the patients were informed of the study and voluntarily agreed to participate, providing a written consent.
    Randomizationnot detected.
    Blindingnot detected.
    Power AnalysisConsidering a type I error α = 0.05, a power of 0.8 and with 249 positive and 249 negative subjects, a sensitivity (or specificity) of 0.95 can be considered significant with respect to values above or equal to 0.99 (null hypothesis).
    Sex as a biological variablenot detected.
    Cell Line Authenticationnot detected.

    Table 2: Resources

    Antibodies
    SentencesResources
    2.5 Plaque reduction neutralization test (PRNT): A high-throughput PRNT method was used for the fast and accurate quantification of neutralizing antibodies in plasma samples collected from patients exposed to SARS-CoV-2, as described elsewhere (12).
    SARS-CoV-2
    suggested: None
    After 26 h of incubation and cells fixing, visualization of plaques was obtained with an immunocytochemical staining method using an anti-dsRNA monoclonal antibody (J2, 1:10,000; Scicons) for 1 hour, followed by 1-hour incubation with peroxidase-labeled goat anti-mouse antibodies (1:1000; DAKO) and a 7-minute incubation with the True Blue™ (KPL) peroxidase substrate.
    anti-dsRNA
    suggested: (Millipore Cat# MABE1134, RRID:AB_2819101)
    J2
    suggested: (US Biological Cat# U1000-87M, RRID:AB_2210756)
    anti-mouse
    suggested: None
    Experimental Models: Cell Lines
    SentencesResources
    After 1 hour at 37 °C, fifty microliters of the virus–serum mixtures were added to confluent monolayers of Vero E6 cells, in 96-wells plates and incubated for 1 hour at 37 °C, in a 5% CO2 incubator.
    Vero E6
    suggested: None
    Software and Algorithms
    SentencesResources
    The GraphPad Prism version 9.1 for Windows (GraphPad Software, LLC) was employed to evaluate plaque reduction neutralization test results.
    GraphPad Prism
    suggested: (GraphPad Prism, RRID:SCR_002798)
    GraphPad
    suggested: (GraphPad Prism, RRID:SCR_002798)
    Stata v16.1 (Statacorp, Lakeway Drive, TX, USA) was used to evaluate the assays’ clinical performances.
    Statacorp
    suggested: None

    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    This study presented several limitations. First, neutralizing antibodies were mainly tested in a well-defined cohort of family cluster, with sera collected at various time points and, therefore, should be confirmed in further studies; second, COVID-19 positive patients were selected retrospectively on the basis of available leftover samples, and third cross-reactivity with seasonal human coronaviruses was not assessed; therefore NPV and PPV could be overestimated. Another limitation of this study is that no longitudinal sera were analyzed and, therefore, we cannot exclude that some patients might have seroconverted at later time points. In conclusion, the data reported in this study showed that anti-SARS-CoV-2 S-RBD IgG assay achieves excellent analytical and clinical performances. Since specificity results were not 100%, the assay might present a limited number of false-positive results and this characteristic could be further confirmed in a more representative number of samples. However, the correlation with sera neutralization activity was very elevated, demonstrating that the dynamic range of the assay is expanded enough to capture all clinically significant NAb results. Finally, an appropriate threshold could be derived for selecting samples for COVID-19 convalescent plasma therapy.

    Results from TrialIdentifier: No clinical trial numbers were referenced.


    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


    Results from JetFighter: We did not find any issues relating to colormaps.


    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.