An attention-weighted tri-modal ultrasound network (TUS-Net) for screening of atypical hepatocellular carcinoma from LR-M liver nodules

Objective Discriminating atypical hepatocellular carcinoma (HCC) from other malignancies in liver nodules classified as LR-M (Liver Imaging Reporting and Data System category M) remains a significant diagnostic challenge on conventional ultrasound examination. The LR-M category, originally intended to capture non-HCC malignancies, paradoxically contains up to 63% of atypical HCCs that deviate from classic enhancement patterns, leading to potential misdiagnosis and suboptimal treatment planning. While deep learning has shown promise in HCC diagnosis, most existing models rely exclusively on single-modality ultrasound, overlooking the diagnostic benefits of integrating complementary information from multiple imaging sources. To address this gap, we propose a novel attention-weighted tri-modal ultrasound network (TUS-Net) that integrates contrast-enhanced ultrasound (CEUS), B-mode ultrasound (BUS), and time-intensity curves (TICs) to improve diagnostic accuracy for these clinically challenging lesions. Methods Our framework incorporates a three-dimensional convolutional neural network (C3D) backbone to extract spatiotemporal features from CEUS videos, capturing dynamic vascular patterns critical for lesion characterization. To effectively fuse complementary modalities, we introduce a dual-channel feature fusion module (DCFFM) that adaptively combines features from CEUS and BUS through channel-wise attention mechanisms, allowing the model to dynamically weigh the contribution of each modality based on diagnostic relevance. Additionally, we propose a temporal intensity feature fusion module (TIFFM) that leverages quantitative hemodynamic information from TICs to guide the model’s attention toward diagnostically critical temporal phases, such as arterial wash-in and portal venous washout. The model is further enhanced by automated lesion localization using YOLOX and class activation mapping for interpretability, ensuring that predictions align with clinically meaningful imaging features. Results Evaluated on a tri-modal ultrasound dataset comprising 161 patients with pathologically confirmed LR-M nodules (131 atypical HCC and 30 non-HCC malignancies), our model achieved an accuracy of 86.83%, a sensitivity of 92.50%, a specificity of 75.50%, and an AUC of 89.32% in screening atypical HCC. Compared to single-modality baselines, TUS-Net demonstrated superior specificity, a clinically critical metric given the higher risk associated with misclassifying non-HCC malignancies. Ablation studies confirmed the contribution of each module, with the full model outperforming both standard C3D and 3D ResNet backbones integrated with attention mechanisms. A reader study involving junior and senior radiologists further validated the clinical utility of AI assistance, showing consistent improvements in specificity and inter-reader consistency, particularly for less experienced clinicians. Conclusion These results surpass existing benchmark models and demonstrate the potential of our approach to enhance diagnostic precision in clinically specific cases. By intelligently fusing multi-modal ultrasound data with attention-guided mechanisms, TUS-Net offers a reliable and interpretable tool that holds promise for improving the non-invasive diagnosis of atypical HCC in challenging LR-M liver nodules.