Trust Me, I Might be a Medical Device: The Problem with AI Scribes
Discuss this preprint
Start a discussion What are Sciety discussions?Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
Background AI-enabled digital medical scribes are increasingly promoted as a solution to documentation burden and burnout in UK primary care. Recent NHS guidance indicates that many such tools may fall within the scope of UK Medical Devices Regulations, yet there is a lack of support for clinicians to verify regulatory status or data governance claims. Objective To identify AI-powered health care digital scribe (ambient voice technology, AVT) products available to UK clinicians and evaluate the transparency of their regulatory, data-protection and NHS-readiness claims. Methods Between 1–15 November 2025 we conducted a structured web-based review using search engines, NHS innovation and procurement portals, regulatory databases (including the MHRA Public Access Registration Database), commercial catalogues and vendor materials. Products were eligible if they were marketed as healthcare AI scribes or consultation assistants that transcribe and/or summarise clinician–patient interactions. For each tool, we extracted information on features, GDPR statements, MHRA registration, claimed NHS use and access pathways. Results We identified 118 AI-enabled health care AVT products marketed as AI scribes. Only nine (7%) explicitly claimed Class I medical device status; of these, six could be definitively located on the MHRA register under the same or a clearly linked legal entity. An explicit GDPR or data-protection statement was present for 88 products (73%), but supporting evidence (e.g. DPIAs, UK-specific safeguards) was rarely available. In terms of market accessibility, 51 tools (42%) required direct vendor contact or a demonstration, 46 (38%) showed clear UK or NHS availability, 15 (12%) were not accessible to UK users, and access status was unclear for nine (7%). Conclusions There is a marked mismatch between emerging NHS expectations for AI-enabled medical scribes and the transparency of current market offerings. Clinicians may struggle to reliably verify which tools are registered medical devices, how patient data are processed, or whether NHS clinical safety standards are met. Although NHS England has since introduced a national self-certified Ambient Voice Technology (AVT) supplier registry to improve visibility of regulatory and governance compliance, this was published after completion of data collection for this study. While the registry represents an important step toward strengthening oversight, its impact will depend on supplier participation, accuracy of self-certification, and effective dissemination to clinicians and healthcare organisations.