Strengthening policy coding methodologies to improve COVID-19 disease modeling and policy responses: a proposed coding framework and recommendations

  1. Jeff Lane
  2. Michelle M. Garrison
  3. James Kelley
  4. Priya Sarma
  5. Aaron Katz

Reviewed by

Read the full article

Listed in

Log in to save this article

Abstract

Background

In recent months, multiple efforts have sought to characterize COVID-19 social distancing policy responses. These efforts have used various coding frameworks, but many have relied on coding methodologies that may not adequately describe the gradient in social distancing policies as states “re-open.”

Methods

We developed a COVID-19 social distancing intensity framework that is sufficiently specific and sensitive to capture this gradient. Based on a review of policies from a 12 U.S. state sample, we developed a social distancing intensity framework consisting of 16 domains and intensity scales of 0–5 for each domain.

Results

We found that the states with the highest average daily intensity from our sample were Pennsylvania, Washington, Colorado, California, and New Jersey, with Georgia, Florida, Massachusetts, and Texas having the lowest. While some domains (such as restaurants and movie theaters) showed bimodal policy intensity distributions compatible with binary (yes/no) coding, others (such as childcare and religious gatherings) showed broader variability that would be missed without more granular coding.

Conclusion

This detailed intensity framework reveals the granularity and nuance between social distancing policy responses. Developing standardized approaches for constructing policy taxonomies and coding processes may facilitate more rigorous policy analysis and improve disease modeling efforts.

Article activity feed

  1. Version published to 10.1186/s12874-020-01174-w
  2. ScreenIT

    SciScore for 10.1101/2020.08.12.20173740: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    Institutional Review Board Statementnot detected.
    Randomizationnot detected.
    Blindingnot detected.
    Power Analysisnot detected.
    Sex as a biological variablenot detected.

    Table 2: Resources

    Software and Algorithms
    SentencesResources
    Interpretation notes were added to the Excel datasheet to document key interpretations.
    Excel
    suggested: None

    Results from OddPub: Thank you for sharing your code and data.

    Results from LimitationRecognizer: An explicit section about the limitations of the techniques employed in this study was not found. We encourage authors to address study limitations.

    Results from TrialIdentifier: No clinical trial numbers were referenced.

    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.

    Results from JetFighter: We did not find any issues relating to colormaps.

    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.

  3. Version published to 10.1101/2020.08.12.20173740v1 on medRxiv