Examining disparities relating to service reach and patient engagement with COVID-19 remote home monitoring services in England: a mixed methods rapid evaluation

This article has been Reviewed by the following groups

Read the full article

Abstract

Background

The adoption of remote methods of care has been accelerated by the COVID-19 pandemic, but concerns exist relating to the potential impact on health disparities. This evaluation explores the implementation of COVID-19 remote home monitoring services across England, focussing on patients’ experiences and engagement with the service.

Methods

The study was a rapid, multi-site, mixed methods evaluation. Data were collected between January and June 2021. We conducted qualitative interviews with staff service leads, and patients and carers receiving the service. We conducted quantitative surveys with staff delivering the service, and patients and carers receiving the service across 28 sites in England, UK. Qualitative data were analysed using thematic analysis and quantitative data were analysed using univariate and multivariate methods.

Findings

Many sites designed their service to be inclusive to the needs of their local population. Strategies included widening eligibility criteria, prioritising vulnerable groups, and creating referral pathways. Many sites also adapted their services according to patient needs, including providing information in different languages or more accessible formats, offering translation services, offering non-digital options, or providing face-to-face assessments. Despite these adaptions, disparities were reported across patient groups (e.g. age, health status, ethnicity, level of education) in their experience of and engagement with the service.

Interpretation

Services must determine how best to design and implement remote monitoring services to be of value to all populations. National guidance should play a role in supporting services to best serve the needs of their populations, and patients and staff must play an active role in service design.

Funding

This is independent research funded by the National Institute for Health Research, Health Services & Delivery Research programme (RSET Project no. 16/138/17; BRACE Project no. 16/138/31) and NHSEI. NJF is an NIHR Senior Investigator. The views expressed in this publication are those of the authors and not necessarily those of the National Institute for Health Research or the Department of Health and Social Care.

Research in context

Evidence before this study

Evidence shows COVID-19 has a disproportionate impact on certain population groups, such as ethnic minority groups, older adults and those with comorbidities. The rapid adoption and spread of remote home monitoring services in England must be accompanied by evaluations at a local level to monitor the impact on health disparities in local populations.

Added value of this study

This rapid mixed methods evaluation of COVID-19 home monitoring services adopted across 28 sites in England aimed to increase understanding of how services have been designed and delivered to address local population needs to increase accessibility to the service and facilitate engagement with the service. We add to the literature by identifying a range of local service adaptations which aim to increase reach and facilitate patient engagement, and consider their potential impact on health disparities. We found strategies included prioritising vulnerable groups, creating referral pathways, offering translation services, offering non-digital options, or providing face-to-face assessments. Despite efforts to adapt services to meet local needs, disparities across patient groups in their experience of, and engagement with, the service (related to age, health status, ethnicity, and level of education) were reported.

Implications of the available evidence

At both a national and local level, and particularly given the increasing use of remote home monitoring schemes, lessening health disparities must be a primary focus in the design and delivery of remote monitoring models for COVID-19 and other conditions. Future research should focus on how best to design and evaluate remote monitoring services, for a range of conditions, especially for patients residing in areas where significant health disparities persist, as well as addressing the effectiveness of any strategies on specific population groups.

Article activity feed

  1. SciScore for 10.1101/2022.02.21.22270793: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    EthicsConsent: An informed consent process using participant information sheets and written consent was used for both staff and patient interviews to ensure informed and voluntary participation.
    Sex as a biological variablenot detected.
    Randomizationnot detected.
    Blindingnot detected.
    Power Analysisnot detected.

    Table 2: Resources

    Software and Algorithms
    SentencesResources
    Data analysis: Quantitative surveys: We analysed survey data using SPSS statistical software (version 25).
    SPSS
    suggested: (SPSS, RRID:SCR_002865)

    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    Strengths and limitations: Our research has several strengths which add to the validity of our findings. The mixed methods design allowed for the triangulation of data across data sources. The evaluation was conducted across several sites and the large number of staff and patients sampled increase the generalisability of findings. The evaluation team was multidisciplinary, which facilitated triangulation and interpretation. However, limitations should be noted. Several patient groups were underrepresented in the survey when compared to national onboarding data (see results section). In addition, the response rate for the patient survey was relatively low (17.5%) so some impact of selection bias cannot be ruled out. Findings might not be representative of all patient groups and experiences; such as those not referred, who declined or disengaged from the service. The analysis of experience and engagement across patient groups could have been subject to false positives due to the number of comparisons made, although a more stringent p-value was used (p<.01) in reporting significant results. When making comparisons between patient groups, the sample size of several groups was relatively small (e.g. patients aged over 80 years). Qualitative interviews with patients focused on experiences of the service more broadly and not necessarily inequalities, so much of our analysis draws on staff perspectives or patient survey data. Future research: There is little published literature on t...

    Results from TrialIdentifier: No clinical trial numbers were referenced.


    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


    Results from JetFighter: We did not find any issues relating to colormaps.


    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    Results from scite Reference Check: We found no unreliable references.


    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.