Adoption, usability and perceived clinical value of a UK AI clinical reference platform: a mixed-methods formative evaluation of real-world usage and a 1,223-respondent user survey

Read the full article See related articles

Listed in

This article is not in any list yet, why not save it to one of your lists.
Log in to save this article

Abstract

Objectives To describe the design of a UK-centred retrieval-augmented clinical reference platform, and report early real-world adoption and perceived clinical utility from a formative implementation evaluation. Methods We conducted a mixed-methods study comprising (i) a retrospective observational analysis of platform usage across web, iOS and Android over 16 weeks and (ii) a cross-sectional, in-product intercept survey. Usage data (unique users, engagement events, clinical queries) were sourced from Google Analytics 4, Apple App Store Connect and Google Play Console. A client-side script randomised survey prompts to ~ 10% of web sessions, displaying single items from a predefined battery. Proportions are reported with Wilson 95% confidence intervals; qualitative comments underwent thematic content analysis. No personal identifiers were collected. Results The web application attracted 19,269 unique users and 202,660 engagement events (~ 10.5 per active user), with approximately 40,000 clinical queries across platforms. The intercept survey yielded 1,223 item-level responses. Among respondents: useful 86.2% (50/58); time saved 60.9% (14/23); would use again 93.3% (14/15); would recommend 88.4% (38/43); perceived accuracy 75.0% (30/40); perceived reliability 79.4% (27/34). Themes highlighted speed, guideline-grounded answers and UK specificity. Discussion Findings provide formative signals of value for rapid, provenance-bound information retrieval. Key limitations include small item-level Ns, early-adopter/selection bias, and absence of gold-standard accuracy benchmarking; results should not be interpreted as evidence of clinical effectiveness. Conclusion A safety-governed, RAG-based platform showed early uptake and favourable user sentiment among UK clinicians. Prospective evaluations, time-and-motion studies and objective accuracy/safety audits, are warranted to assess impact on clinical workflows and care quality.

Article activity feed