Quantifying the potential value of antigen-detection rapid diagnostic tests for COVID-19: a modelling analysis

This article has been Reviewed by the following groups

Read the full article See related articles

Abstract

Background

Testing plays a critical role in treatment and prevention responses to the COVID-19 pandemic. Compared to nucleic acid tests (NATs), antigen-detection rapid diagnostic tests (Ag-RDTs) can be more accessible, but typically have lower sensitivity and specificity. By quantifying these trade-offs, we aimed to inform decisions about when an Ag-RDT would offer greater public health value than reliance on NAT.

Methods

Following an expert consultation, we selected two use cases for analysis: rapid identification of people with COVID-19 amongst patients admitted with respiratory symptoms in a ‘hospital’ setting and early identification and isolation of people with mildly symptomatic COVID-19 in a ‘community’ setting. Using decision analysis, we evaluated the health system cost and health impact (deaths averted and infectious days isolated) of an Ag-RDT-led strategy, compared to a strategy based on NAT and clinical judgement. We adopted a broad range of values for ‘contextual’ parameters relevant to a range of settings, including the availability of NAT and the performance of clinical judgement. We performed a multivariate sensitivity analysis to all of these parameters.

Results

In a hospital setting, an Ag-RDT-led strategy would avert more deaths than a NAT-based strategy, and at lower cost per death averted, when the sensitivity of clinical judgement is less than 90%, and when NAT results are available in time to inform clinical decision-making for less than 85% of patients. The use of an Ag-RDT is robustly supported in community settings, where it would avert more transmission at lower cost than relying on NAT alone, under a wide range of assumptions.

Conclusions

Despite their imperfect sensitivity and specificity, Ag-RDTs have the potential to be simultaneously more impactful, and have a lower cost per death and infectious person-days averted, than current approaches to COVID-19 diagnostic testing.

Article activity feed

  1. SciScore for 10.1101/2020.11.20.20235317: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    NIH rigor criteria are not applicable to paper type.

    Table 2: Resources

    No key resources detected.


    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    Certain limitations of scope bear mention. Our focus in this work is on identifying the circumstances in which an Ag-RDT might be most valuable, given a pre-specified performance profile. Recent guidance published by WHO addresses target product profiles for Ag-RDTs: that is, how a test should best be optimised in terms of accuracy, cost and ease-of-use, for specified use cases (11). For simplicity, our approach treats transmission-related impact of testing as being directly proportional to the number of days for which testing results in isolation of an infectious person, without considering variation between individuals or over time in the degree of infectivity or the strictness of isolation. Similarly, our assessment of mortality outcomes does not account for the potential of a test to indirectly reduce incidence and mortality by interrupting transmission. Further work using dynamic models of SARS-CoV-2 transmission would be valuable in addressing this gap. In addition, while our results are based on a broad sensitivity analysis, it should be noted that these same results may depend on the range of parameters that we have assumed, and indeed these ranges may vary across different settings. Our user-friendly tool allows users to adapt some of these ranges to specific settings. Amongst other limitations, we have adopted several simplifications, perhaps most importantly assuming a dichotomy between ‘acute’ and ‘recent’ infection and the detectability of each by NAT or Ag-RDT. ...

    Results from TrialIdentifier: No clinical trial numbers were referenced.


    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


    Results from JetFighter: We did not find any issues relating to colormaps.


    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.