Effect of SARS-CoV-2 digital droplet RT-PCR assay sensitivity on COVID-19 wastewater based epidemiology

This article has been Reviewed by the following groups

Read the full article See related articles

Abstract

We developed and implemented a framework for examining how molecular assay sensitivity for a viral RNA genome target affects its utility for wastewater-based epidemiology. We applied this framework to digital droplet RT-PCR measurements of SARS-CoV-2 and Pepper Mild Mottle Virus genes in wastewater. Measurements were made using 10 replicate wells which allowed for high assay sensitivity, and therefore enabled detection of SARS-CoV-2 RNA even when COVID-19 incidence rates were relatively low (~10 −5 ). We then used a computational downsampling approach to determine how using fewer replicate wells to measure the wastewater concentration reduced assay sensitivity and how the resultant reduction affected the ability to detect SARS-CoV-2 RNA at various COVID-19 incidence rates. When percent of positive droplets was between 0.024% and 0.5% (as was the case for SARS-CoV-2 genes during the Delta surge), measurements obtained with 3 or more wells were similar to those obtained using 10. When percent of positive droplets was less than 0.024% (as was the case prior to the Delta surge), then 6 or more wells were needed to obtain similar results as those obtained using 10 wells. When COVID-19 incidence rate is low (~ 10 −5 ), as it was before the Delta surge and SARS-CoV-2 gene concentrations are <10 4 cp/g, using 6 wells will yield a detectable concentration 90% of the time. Overall, results support an adaptive approach where assay sensitivity is increased by running 6 or more wells during periods of low SARS-CoV-2 gene concentrations, and 3 or more wells during periods of high SARS-CoV-2 gene concentrations.

Article activity feed

  1. SciScore for 10.1101/2022.04.17.22273949: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    EthicsIRB: The Institutional Review Board of Stanford University determined that this project does not meet the definition of human subject research as defined in federal regulations 45 CFR 46.102 or 21 CFR 50.3 and indicated that no formal IRB review is required.
    Field Sample Permit: The solids samples were processed within 24 hours of collection exactly according to the methods described by Wolfe et al.2 and are summarized in the SI.
    Sex as a biological variablenot detected.
    RandomizationDownsampling simulation: In order to estimate the SARS-CoV-2 N gene and PMMoV RNA concentration we would have obtained if we had run a smaller number of wells (X = 1 - 9), we randomly selected X wells from the 10 wells to calculate the resultant concentration:where 0.00085 μL is the volume of a single droplet14.
    Blindingnot detected.
    Power Analysisnot detected.

    Table 2: Resources

    Software and Algorithms
    SentencesResources
    Data for each individual well was downloaded from QuantaSoft Analysis Pro software (BioRad, CA, version 1.0.596).
    QuantaSoft Analysis Pro
    suggested: None
    Statistical analysis: Statistics were computed using RStudio (version 1.4.1106).
    RStudio
    suggested: (RStudio, RRID:SCR_000432)

    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    There are a few limitations of this analysis. First, in our analysis, we assumed that the measurement obtained using 10 wells is the “true concentration” and compared all results simulated with fewer than 10 wells to the true concentration and its error from the ddRT-PCR instrument. Second, the results presented herein regarding assay sensitivity, and in particular the C0.5 values in Table 1 are specific to the methods applied in this study. The relationship between the number of wells used to the number of non-detects, and the lowest measurable concentration will be impacted by the pre-analytical and analytical processes used. While the specific values in Table 1 are not externally valid, unless others are using our exact methods (available on protocols.io18–20), the framework for examining the required sensitivity for wastewater surveillance is. That is, careful attention to how sensitivity affects the lowest measurable concentration and the number of non-detects, as well as the relationships between these values and laboratory confirmed COVID-19 incidence rates is needed to fully understand how decisions on assay implementation are made.

    Results from TrialIdentifier: No clinical trial numbers were referenced.


    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


    Results from JetFighter: We did not find any issues relating to colormaps.


    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    Results from scite Reference Check: We found no unreliable references.


    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.