Diagnosing SARS-CoV-2 infection: the danger of over-reliance on positive test results

This article has been Reviewed by the following groups

Read the full article

Abstract

Contrary to the practice during previous epidemics, with COVID-19 health authorities have treated a single positive result from a PCR-based test as confirmation of infection, irrespective of signs, symptoms and exposure. This is based on a widespread belief that positive results in these tests are highly reliable. However, evidence from external quality assessments and real-world data indicate enough a high enough false positive rate to make positive results highly unreliable over a broad range of scenarios. This has clinical and case management implications, and affects an array of epidemiological statistics, including the asymptomatic ratio, prevalence, and hospitalization and death rates, as well as epidemiologic models. Steps should be taken to raise awareness of false positives and reduce their frequency. The most important immediate action is to check positive results with additional tests, at least when prevalence is low.

Key messages

The high specificities (usually 100%) reported in PCR-based tests for SARS-CoV-2 infection do not represent the real-world use of these tests, where contamination and human error produce significant rates of false positives.

Widespread lack of awareness of the real-world false positive rates affects an array of clinical, case management and health policy decisions. Similarly, health authorities’ guidance on interpreting test results is often wrong.

Steps should be taken immediately to reduce the frequency and impacts of false positive results, including checking positive results with additional tests at least when prevalence is low.

Article activity feed

  1. SciScore for 10.1101/2020.04.26.20080911: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    Institutional Review Board Statementnot detected.
    Randomizationnot detected.
    Blindingnot detected.
    Power Analysisnot detected.
    Sex as a biological variablenot detected.

    Table 2: Resources

    No key resources detected.


    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


    Results from LimitationRecognizer: An explicit section about the limitations of the techniques employed in this study was not found. We encourage authors to address study limitations.

    Results from TrialIdentifier: No clinical trial numbers were referenced.


    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


    Results from JetFighter: We did not find any issues relating to colormaps.


    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.

  2. SciScore for 10.1101/2020.04.26.20080911: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    Institutional Review Board Statementnot detected.Randomizationnot detected.BlindingExternal quality assessments (EQAs) test the implementation of medical diagnostic assays by providing participating laboratories with blind panels of positive and negative samples.Power AnalysisClinical trials could lose statistical power by unwittingly enrolling false-positive individuals, who would be exposed to potentially harmful side effects without any mitigating potential for benefit.Sex as a biological variablenot detected.

    Table 2: Resources


    Results from OddPub: We did not find a statement about open data. We also did not find a statement about open code. Researchers are encouraged to share open data when possible (see Nature blog).


    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore is not a substitute for expert review. SciScore checks for the presence and correctness of RRIDs (research resource identifiers) in the manuscript, and detects sentences that appear to be missing RRIDs. SciScore also checks to make sure that rigor criteria are addressed by authors. It does this by detecting sentences that discuss criteria such as blinding or power analysis. SciScore does not guarantee that the rigor criteria that it detects are appropriate for the particular study. Instead it assists authors, editors, and reviewers by drawing attention to sections of the manuscript that contain or should contain various rigor criteria and key resources. For details on the results shown here, including references cited, please follow this link.