Design of the HPV-automated visual evaluation (PAVE) study: Validating a novel cervical screening strategy

  1. Silvia de Sanjosé
  2. Rebecca B Perkins
  3. Nicole Campos
  4. Federica Inturrisi
  5. Didem Egemen
  6. Brian Befano
  7. Ana Cecilia Rodriguez
  8. Jose Jerónimo
  9. Li C Cheung
  10. Kanan Desai
  11. Paul Han
  12. Akiva P Novetsky
  13. Abigail Ukwuani
  14. Jenna Marcus
  15. Syed Rakin Ahmed
  16. Nicolas Wentzensen
  17. Jayashree Kalpathy-Cramer
  18. Mark Schiffman
  19. On behalf of the PAVE Study Group

  • Curated by eLife

    eLife logo

    eLife assessment

    This important study will provide evidence about a novel screen-triage-treat strategy for cervical cancer prevention. The trial will generate convincing evidence regarding the efficacy, effectiveness, cost-effectiveness, feasibility and acceptability in a range of geographically spread low-resource settings. The strategy should contribute to improving access to cervical cancer prevention to vulnerable women with low access to health care, and, therefore, at the highest risk of cervical cancer.

Reviewed by

Read the full article

Listed in

Log in to save this article

Abstract

The HPV-automated visual evaluation (PAVE) Study is an extensive, multinational initiative designed to advance cervical cancer prevention in resource-constrained regions. Cervical cancer disproportionally affects regions with limited access to preventive measures. PAVE aims to assess a novel screening-triage-treatment strategy integrating self-sampled HPV testing, deep-learning-based automated visual evaluation (AVE), and targeted therapies.

Methods:

Phase 1 efficacy involves screening up to 100,000 women aged 25–49 across nine countries, using self-collected vaginal samples for hierarchical HPV evaluation: HPV16, else HPV18/45, else HPV31/33/35/52/58, else HPV39/51/56/59/68 else negative. HPV-positive individuals undergo further evaluation, including pelvic exams, cervical imaging, and biopsies. AVE algorithms analyze images, assigning risk scores for precancer, validated against histologic high-grade precancer. Phase 1, however, does not integrate AVE results into patient management, contrasting them with local standard care.

Phase 2 effectiveness focuses on deploying AVE software and HPV genotype data in real-time clinical decision-making, evaluating feasibility, acceptability, cost-effectiveness, and health communication of the PAVE strategy in practice.

Results:

Currently, sites have commenced fieldwork, and conclusive results are pending.

Conclusions:

The study aspires to validate a screen-triage-treat protocol utilizing innovative biomarkers to deliver an accurate, feasible, and cost-effective strategy for cervical cancer prevention in resource-limited areas. Should the study validate PAVE, its broader implementation could be recommended, potentially expanding cervical cancer prevention worldwide.

Funding:

The consortial sites are responsible for their own study costs. Research equipment and supplies, and the NCI-affiliated staff are funded by the National Cancer Institute Intramural Research Program including supplemental funding from the Cancer Cures Moonshot Initiative. No commercial support was obtained. Brian Befano was supported by NCI/ NIH under Grant T32CA09168.

Article activity feed

  1. Version published to 10.7554/elife.91469.3 on eLife
  2. Version published to 10.7554/elife.91469 on eLife
  3. Version published to 10.7554/elife.91469.2 on eLife
  4. eLife

    Author Response

    The following is the authors’ response to the original reviews.

    Reviewer #1 (Recommendations For The Authors):

    It is not clear if the cost-effectiveness cited refers exactly to the PAVE protocol. No line item costings are given. As far as I know, the AmpFire test is very expensive (some 6 USD) and AI-assisted colposcopy has at least formerly been very expensive.

    Response: As mentioned in the section on "Cost-effectiveness analysis," the cost-effectiveness results refer to "an early exercise to approximate the potential costs and benefits of a highly effective screening campaign delivered to women aged 30-49 years in the ~65 highest burden LMIC (Figure 1; Suppl Materials) and an HPV vaccination program delivered to girls aged 9-14 years". Because this modeling was intended to be a high-level approximation prior to the availability of micro-costing and use of a new microsimulation model reflecting the epidemiology of HPV in PAVE study sites, we used a bundled cost of US$15 per woman screened and managed appropriately, including the ~$6 cost of the ScreenFire test, triage with AVE for women with HPV positivity, and treatment based on risk stratification. Micro-costing and microsimulation model development for PAVE sites are ongoing alongside the study and will have the capability to reflect setting-specific differences in delivery costs, as well as different burdens of HPV and precancer. These refinements of costing and cost-effectiveness estimates are a high priority of the PAVE consortium

    Reviewer #2 (Recommendations For The Authors):

    As mentioned above, the description of phase 2 could be improved. I suggest that the inclusion of Implementation Science frameworks and tools could contribute to strengthening methods to measure implementation outcomes. Perhaps if the protocol and scope of the study allows it, I suggest that the authors evaluate the incorporation of the assessment of barriers and facilitators of implementation to inform future scaling up of the PAVE strategy. To do this, for example, some Implementation Science Frameworks, such as Conceptual Framework of Implementation Research (CFIR)1-2 could be useful. In addition, as the authors mentioned, future dissemination will need an effective communication strategy and to design it they will carry out a pilot study. The inclusion of CFIR framework or other similar framework, could contribute to identifying contextual factors that might affect implementation and contribute to designing an accurate implementation and dissemination strategy.

    The authors also mentioned that if the PAVE strategy is effective, it could replace the current standard of care. This fact would lead to the need to carry out a des-implementation process. This process needs stakeholders' engagement and political will, among other contextual factors (e.g., human resources, organizational changes, etc.). Implementation of new strategies needs that implementers perceive it as acceptable, adaptable, compatible and with greater advantages than the usual practice. In this sense, the analysis of implementation outcomes guided by CFIR framework could play an important role in this future des-implementation process.

    1. Damschroder, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Sci 4, 50 (2009) https://doi.org/10.1186/1748-5908-4-50.
    1. Damschroder, L.J., Reardon, C.M., Widerquist, M.A.O. et al. The updated Consolidated Framework for Implementation Research based on user feedback. Implementation Sci 17, 75 (2022). https://doi.org/10.1186/s13012-022-01245-0

    Response: Phase 2 refers to limited aspects of PAVE implementation, mainly introducing the management algorithms and evaluating the acceptability by providers and patients. Based on preliminary results of PAVE in the efficacy analysis a more comprehensive implementation intervention is being planned.

    Reviewer #3 (Recommendations For The Authors):

    This is a very strong protocol and obviously the synthesis of many years' of work. I have some minor suggestions only.

    The issue raised as a weakness could be addressed by specifying that biopsy adequacy is evaluated by the local histopathologist. Those cases that don't contain at least some stroma and only superficial strips of epithelium should probably be assessed as "unsatisfactory" and excluded from triage performance calculations.

    While endocervical curettage is commonly performed in North America, resulting in good quality samples, there is considerable global variation in this practice. The procedure yielding high quality samples is usually somewhat painful due to the cervical dilation and may in fact be more painful than small biopsies.

    Response: We are undertaking a thorough evaluation of histology assessment together with the on-site pathologists and an external expert reviewer. It is critical that the study material be of good quality and that the diagnosis be highly accurate as these elements are critical for patient management but also for an adequate training of the AI algorithm. We are recommending to use for endocervical sampling a soft tissue by Histologics that provides excellent material and it is reported to be less painful than regular curette. Pathologists are requested to verify the quality of the sampling of this approach.

    The sentence starting at line 311 could add that, clinicians also record transformation type and/ or colposcopy adequacy.

    Response: Added

    The clinicians are reporting the VIA or the colposcopy impression and also the visibility of the SCJ.

    The manuscript could be strengthened by specifying what will happen to people who have HPV detected and are triage negative. Will they be recalled for follow-up HPV test at around 12 months or some other interval?

    Finally, will those who have been treated be recalled for a follow-up HPV test at around 12 months, particularly those treated with thermal ablation? Follow-up of people in whom HPV is detected, whether triage negative or positive (and treated) would strengthen the study and enhance participant safety. If this is already planned it would strengthen the manuscript to cover these aspects.

    Response: The PAVE strategy runs under a Consortium agreement and thus we cannot dictate specific protocols for follow-up. We are very eager to promote an adequate follow-up for those with a triage test negative, but the monitoring of its implementation is beyond PAVE. All settings have under their guidelines a yearly follow-up for any woman receiving thermal ablation and shorter intervals for those getting LEEP (LLETZ).

  5. eLife

    eLife assessment

    This important study will provide evidence about a novel screen-triage-treat strategy for cervical cancer prevention. The trial will generate convincing evidence regarding the efficacy, effectiveness, cost-effectiveness, feasibility and acceptability in a range of geographically spread low-resource settings. The strategy should contribute to improving access to cervical cancer prevention to vulnerable women with low access to health care, and, therefore, at the highest risk of cervical cancer.

  6. eLife

    Reviewer #1 (Public Review):

    Summary: A description of a modern protocol for cervical screening that likely could be used in any country of the world, based on self-sampling, extended HPV genotypinng and AI-assisted visual inspection - which is probably the best available combination today.

    Strengths: Modern, optimised protocol, designed for global use. Innovative.

    Weaknesses: The protocol is not clear. I could not even find how many women were going to be enrolled, the timelines of the study, the statistical methods ("comparing" is not statistics) or the power calculations.
    Tables 2 and 3 are too schematic - surely the authors must have an approximate idea of what the actual numbers are behind the green, red and yellow colors.
    Figure 1 comparing screening and vaccination is somewhat misleading. They screen 20 birth cohorts but vaccinate only 5 birth cohorts. Furthermore, the theoretical gains of screening has not really been attained in any country in practise. Modelling can be a difficult task and the commentary does not provide any detail on how to evaluate what was done. It just seems unnecessary to attack vaccination as a motivation on why screening needs to be modernised.

  7. eLife

    Reviewer #2 (Public Review):

    Summary:

    This manuscript describes the study protocol, structure and logic of the PAVE strategy. The PAVE study is a multicentric study to evaluate a novel cervical screen-triage-treat strategy for resource-limited settings as part of a global strategy to reduce cervical cancer burden. The PAVE strategy involves: 1) screening with self-sampled HPV testing; 2) triage of HPV-positive participants with a combination of extended genotyping and visual evaluation of the cervix assisted by deep-learning-based automated visual evaluation (AVE); and 3) treatment with thermal ablation or excision (Large Loop Excision of the Transformation Zone). The PAVE study has two phases: efficacy (2023-2024) and effectiveness (planned to begin in 2024-2025). The efficacy phase aims to refine and validate the screen-triage portion of the protocol. The effectiveness phase will examine few implementation of the PAVE strategy into clinical practice. In following phases implementation will further explored.

    Strengths and weaknesses

    The Pave Study develops and evaluates a novel strategy that combines HPV self-collection -that has been proven effective to increase screening coverage in different settings-, with genotyping and Automated Visual Evaluation as triage. The proposed strategy combined three key innovations to improve an important step in the cervical cancer care continuum. If the strategy is effective it will contribute to enhance cervical cancer prevention in low resource settings.

    As authors mentioned, despite the existence of effective preventive technologies (e.g., HPV vaccine and HPV test) translation of the HPV prevention methods has not yet occurred in many Low-Middle-Income Countries. So, in this context, new screen-triage-treat strategies are needed and if PAVE strategy were effective, it could be a landmark for cervical cancer prevention.

    The PAVE Study is a solid and important study that is aimed to be carried out in nine countries and recruit tens thousands of women. It is a study with a large and diverse sample that can provide useful information for the development of this new screen-triage-treat strategy. Another strength is the fact that the PAVE project is integrated into the screening activities placed in the selected countries that will allow to evaluate efficacy and effectiveness in real-word context.

    The manuscript does not present results because its aim is to describe the study protocol, structure and logic of the PAVE strategy.

    Phase 1 aims to evaluate efficacy of the strategy. Methods are well described and are consistent with the study aims.

    Phase 2 aims to evaluate the implementation of the PAVE strategy in clinical practice. The inclusion of implementation evaluation in this type of studies is an important milestone in the field of cervical cancer prevention. It has been shown that many strategies that have proven to be effective in controlled studies face barriers when they are implemented in real life. In that sense, results of phase 2 are key to ensure the future implementation of the strategy.

  8. eLife

    Reviewer #3 (Public Review):

    Summary: Despite being preventable and treatable, cervical cancer remains the second most common cause of cancer death globally. This cancer, and associated deaths, occur overwhelmingly in low- and middle-income countries (LMIC), reflecting a lack of access to vaccination, screening and treatment services. Cervical screening is the second pillar in the WHO strategy to eliminate cervical cancer as a public health problem and will be critical in delivering early gains in cervical cancer prevention as the impact of vaccination will not be realized for several decades. However, screening strategies implemented in high income countries are not feasible or affordable in LMICs. This ambitious multi-center study aims to address these issues by developing and systematically evaluating a novel approach to cervical screening. The approach, based on primary screening with self-collected specimens for HPV testing, is focused on optimizing triage of people in whom HPV is detected, so that sensitivity for the detection of pre-cancer and cancer is maximized while treatment of people without pre-cancer or cancer is minimized.

    Strengths:

    The triage proposed for this study builds on the authors' previously published work in designing the ScreenFire test to appropriately group the 13 detected genotypes into four channels and to develop automated visual evaluation (AVE) of images of the cervix, taken by health workers.

    The move from mobile telephone devices to a dedicated device to acquire and evaluate images, overcomes challenges previously encountered whereby updates of mobile phone models required retraining of the AVE algorithm.

    The separation of the study into two phases, an efficacy phase in which screen positive people will be triaged and treated according to local standard of care and the performance of AVE will be evaluated against biopsy outcomes will be followed by the second phase in which the effectiveness, cost-effectiveness, feasibility and acceptability will be evaluated.

    The setting in a range of low resource settings which are geographically well spread and reflective of where the global cancer burden is highest.

    Weaknesses:

    Potential ascertainment bias due to the lack of specified biopsy (such as small four quadrant biopsies or small biopsies across the transformation zone) when aceto-white areas are not identified. This has the potential lead to lead to an over-estimate of sensitivity of the triage approach, particularly in the setting of VIA as compared to colposcopy. While the authors specify endocervical sampling in this setting, using curette or brush (for cytology), this may not be as sensitive unless clinicians are experienced in endocervical curette procedures.

  9. Version published to 10.1101/2023.08.30.23294826v3 on medRxiv
  10. Version published to 10.7554/elife.91469.1 on eLife
  11. eLife

    eLife assessment

    This important study will provide evidence about a novel screen-triage-treat strategy for cervical cancer prevention. The strategy would contribute to improving access to cervical cancer prevention to vulnerable women with low access to health care, and, therefore, at the highest risk of cervical cancer. However, the current protocol description is currently incomplete and missing key information for clarity and reproducibility.

  12. eLife

    Reviewer #1 (Public Review):

    Summary:

    A description of a modern protocol for cervical screening that likely could be used in any country of the world, based on self-sampling, extended HPV genotyping and AI-assisted visual inspection - which is probably the best available combination today.

    Strengths:

    Modern, optimised protocol, designed for global use. Innovative.

    Weaknesses:

    The protocol is not clear. I could not even find how many women were going to be enrolled, the timelines of the study, the statistical methods ("comparing" is not statistics) or the power calculations.

    Tables 2 and 3 are too schematic - surely the authors must have an approximate idea of what the actual numbers are behind the green, red and yellow colors.

    Figure 1 comparing screening and vaccination is somewhat misleading. They screen 20 birth cohorts but vaccinate only 5 birth cohorts. Furthermore, the theoretical gains of screening has not really been attained in any country in practice. Modelling can be a difficult task and the commentary does not provide any detail on how to evaluate what was done. It just seems unnecessary to attack vaccination as a motivation on why screening needs to be modernised.

  13. eLife

    Reviewer #2 (Public Review):

    Summary:

    This manuscript describes the study protocol, structure and logic of the PAVE strategy. The PAVE study is a multicentric study to evaluate a novel cervical screen-triage-treat strategy for resource-limited settings as part of a global strategy to reduce cervical cancer burden. The PAVE strategy involves: 1) screening with self-sampled HPV testing; 2) triage of HPV-positive participants with a combination of extended genotyping and visual evaluation of the cervix assisted by deep-learning-based automated visual evaluation (AVE); and 3) treatment with thermal ablation or excision (Large Loop Excision of the Transformation Zone). The PAVE study has two phases: efficacy (2023-2024) and effectiveness (planned to begin in 2024-2025). The efficacy phase aims to refine and validate the screen-triage portion of the protocol. The effectiveness phase will examine implementation of the PAVE strategy into clinical practice.

    Strengths and weaknesses:

    The Pave Study develops and evaluates a novel strategy that combines HPV self-collection, that has been proven effective to increase screening coverage in different settings, with genotyping and Automated Visual Evaluation as triage. The proposed strategy combined three key innovations to improve an important step in the cervical cancer care continuum. If the strategy is effective it will contribute to enhancing cervical cancer prevention in low resource settings.

    As the authors mentioned, despite the existence of effective preventive technologies (e.g., HPV vaccine and HPV test) translation of the HPV prevention methods has not yet occurred in many Low-Middle-Income Countries. So, in this context, new screen-triage-treat strategies are needed and if PAVE strategy were effective, it could be a landmark for cervical cancer prevention.

    The PAVE Study is a solid and important study that is aimed to be carried out in nine countries and recruit tens of thousands of women. It is a study with a large and diverse sample that can provide useful information for the development of this new screen-triage-treat strategy. Another strength is the fact that the PAVE project is integrated into the screening activities placed in the selected countries that will allow to evaluate efficacy and effectiveness in real-word context.

    The manuscript does not present results because its aim is to describe the study protocol, structure and logic of the PAVE strategy.

    Phase 1 aims to evaluate the efficacy of the strategy. Methods are well described and are consistent with the study aims.

    Phase 2 aims to evaluate the implementation of the PAVE strategy in clinical practice. The inclusion of implementation evaluation in this type of studies is an important milestone in the field of cervical cancer prevention. It has been shown that many strategies that have proven to be effective in controlled studies face barriers when they are implemented in real life. In that sense, the results of phase 2 are key to ensure the future implementation of the strategy.

    However, some aspects of Phase 2 need to be clarified and extended. Although authors mentioned that implementation outcomes, such as acceptability and feasibility will be evaluated, more information is needed about method (i.e. qualitative/quantitative), data collection tools (i.e., survey, semi-structure interviews, focus groups, etc.) and frameworks that will be used to evaluate these implementation outcomes.

  14. eLife

    Reviewer #3 (Public Review):

    Summary:

    Despite being preventable and treatable, cervical cancer remains the second most common cause of cancer death globally. This cancer, and associated deaths, occur overwhelmingly in low- and middle-income countries (LMIC), reflecting a lack of access to vaccination, screening and treatment services. Cervical screening is the second pillar in the WHO strategy to eliminate cervical cancer as a public health problem and will be critical in delivering early gains in cervical cancer prevention as the impact of vaccination will not be realized for several decades. However, screening strategies implemented in high income countries are not feasible or affordable in LMICs. This ambitious multi-center study aims to address these issues by developing and systematically evaluating a novel approach to cervical screening. The approach, based on primary screening with self-collected specimens for HPV testing, is focused on optimizing triage of people in whom HPV is detected, so that sensitivity for the detection of pre-cancer and cancer is maximized while treatment of people without pre-cancer or cancer is minimized.

    Strengths:

    The triage proposed for this study builds on the authors' previously published work in designing the ScreenFire test to appropriately group the 13 detected genotypes into four channels and to develop automated visual evaluation (AVE) of images of the cervix, taken by health workers.

    The move from mobile telephone devices to a dedicated device to acquire and evaluate images overcomes challenges previously encountered whereby updates of mobile phone models required retraining of the AVE algorithm.

    The separation of the study into two phases, an efficacy phase in which screen positive people will be triaged and treated according to local standard of care and the performance of AVE will be evaluated against biopsy outcomes will be followed by the second phase in which the effectiveness, cost-effectiveness, feasibility and acceptability will be evaluated.

    The setting in a range of low resource settings which are geographically well spread and reflective of where the global cancer burden is highest.

  15. Version published to 10.1101/2023.08.30.23294826v2 on medRxiv
  20. Version published to 10.1101/2023.08.30.23294826v1 on medRxiv