A Reproducible Clinical Decision-Support Suite on MIMIC-IV

Read the full article See related articles

Discuss this preprint

Start a discussion What are Sciety discussions?

Listed in

This article is not in any list yet, why not save it to one of your lists.
Log in to save this article

Abstract

This work is a direct extension and modernisation of zMed’s 2021 clinical AI/ML modelling effort, which established the company’s first intensive-care risk models on earlier critical-care data. Here we re-platform that work on the latest MIMIC-IV v3.1 release and substantially broaden it. Most published clinical-AI results are single models on a single dataset, difficult to reproduce, and rarely validated outside their training hospital. We built a broad, methodologically rigorous, reproducible clinical decision-support (CDS) suite spanning four families—intensive-care deterioration and outcomes, emergency-department triage, electrocardiographic interpretation, and clinical natural-language processing—comprising 26 models. Tabular models are gradient-boosted trees over point-in-time, leakage-safe first-24-hour features; deep models include one-dimensional convolutional networks on raw 12-lead ECG, fine-tuned clinical transformers, and an instruction-tuned large language model for discharge-summary drafting. Every model uses patient-level data splits, probability calibration, a shuffled-label leakage gate, and SHAP explanations, and is characterised by its full confusion matrix with sensitivity, specificity and predictive values. Discrimination matched or approached published benchmarks: ICU mortality AUROC 0.884, acute kidney injury 0.830, prolonged stay 0.813; emergency-department-to-ICU 0.875; cardiologist-labelled ECG diagnosis 0.909; full-note diagnostic coding 0.892. Raw-signal ECG deep learning improved myocardial-infarction detection by +0.142 AUROC over interval features. The MIMIC-trained mortality model generalised to a different multi-centre US cohort (199,133 stays) with only a 0.044 AUROC drop. We describe how each model family is incorporated into the latest version of the zMed Critical Care application and its CDS tools.

Article activity feed