SchistoTrackVideoNet: multilabel deep learning-based classification of schistosomal periportal fibrosis from ultrasound video

Schistosomiasis causes a complex, difficult to diagnose form of liver fibrosis with high rates of life-threatening morbidity in resource-poor settings where there are often no trained sonographers. Protocols for diagnosis of schistosomiasis-related liver fibrosis have focused on difficult-to-acquire and subjective ultrasound images dependent on extensive expertise. Here we present SchistoTrackVideoNet, the first deep learning-based video model trained on easy-to-acquire standardised ultrasound video sweeps for classification of schistosomiasis-related liver fibrosis. This video-based classification model was trained and evaluated on video sweeps from 2140 participants aged 5–87 years from three districts in rural Uganda. We tested the model at a clinically-relevant sensitivity threshold (≥90%) and achieved positive predictive values of 0.0968–0.5556 for diverse presentations of liver fibrosis. Our findings show potential for the use of easy-to-acquire video sweeps for diagnosis of schistosomiasis-related liver fibrosis and our model provides a proof-of-concept for deep learning applied to liver ultrasound video for diagnosis of schistosomiasis-related liver morbidity.