When the Best Pandemic Models are the Simplest

This article has been Reviewed by the following groups

Read the full article

Abstract

As the coronavirus pandemic spreads across the globe, people are debating policies to mitigate its severity. Many complex, highly detailed models have been developed to help policy setters make better decisions. However, the basis of these models is unlikely to be understood by non-experts. We describe the advantages of simple models for COVID-19. We say a model is “simple” if its only parameter is the rate of contact between people in the population. This contact rate can vary over time, depending on choices by policy setters. Such models can be understood by a broad audience, and thus can be helpful in explaining the policy decisions to the public. They can be used to evaluate the outcomes of different policies. However, simple models have a disadvantage when dealing with inhomogeneous populations. To augment the power of a simple model to evaluate complicated situations, we add what we call “satellite” equations that do not change the original model. For example, with the help of a satellite equation, one could know what his/her chance is of remaining uninfected through the end of an epidemic. Satellite equations can model the effects of the epidemic on high-risk individuals, death rates, and nursing homes and other isolated populations. To compare simple models with complex models, we introduce our “slightly complex” Model J. We find the conclusions of simple and complex models can be quite similar. However, for each added complexity, a modeler may have to choose additional parameter values describing who will infect whom under what conditions, choices for which there is often little rationale but that can have big impacts on predictions. Our simulations suggest that the added complexity offers little predictive advantage.

Article activity feed

  1. SciScore for 10.1101/2020.06.23.20132522: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    Institutional Review Board Statementnot detected.
    Randomizationnot detected.
    Blindingnot detected.
    Power Analysisnot detected.
    Sex as a biological variablenot detected.

    Table 2: Resources

    No key resources detected.


    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    Limitations of modeling: Complex models seem to benefit from the common belief in the power of data. In a world-wide outbreak there is plenty of data. But when dealing with a deadly disease, reliable experiments are few. Much of the data is worthless to modelers. Complex models can include many parameters that are precise, such as the typical traffic on highways or numbers of people taking mass transit. Their weaknesses is the uncertainty in the parameters that describe transmissions between groups. Complex models are likely to have parameters that describe how many contacts people have in the many specific situations. The most accurately known parameter for transmissions between groups of people is the value of β (or R0). The rate β is not estimated by examining the individual contacts between people. It is estimated from large amounts of data about the growth in the numbers of infected people or hospitalizations or deaths. This most accurate number is likely quite uncertain. If β appears to be 2.5, it may be 2 or 3.5. But there is much less data to determine the transmission parameters or contact rates between subgroups. Hence complex models must be saddled by transmission parameters between subgroups that are less accurate than β. While people are infectious and perhaps asymptomatic, they can encounter many people. How can a model predict how many of these encounters would constitute a contact that transmits infection? We may know the fractions of the populations that are ...

    Results from TrialIdentifier: No clinical trial numbers were referenced.


    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


    Results from JetFighter: We did not find any issues relating to colormaps.


    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.