Tuesday 11 March 2025
Deep learning has revolutionized medical imaging, enabling doctors to diagnose diseases more accurately and quickly than ever before. But there’s a catch: creating these powerful AI models requires a lot of high-quality training data, which can be expensive and time-consuming to collect.
A new paper from researchers at the Chinese University of Hong Kong tackles this problem head-on by introducing MARIO, a mixed-annotation framework that can learn from multiple types of labels simultaneously. This could be a game-changer for medical imaging, where doctors often struggle to provide detailed annotations due to limited resources.
The researchers tested MARIO on five different datasets, including images of colon polyps and lung lesions. They found that the model outperformed existing methods in all cases, achieving higher accuracy and precision when segmenting these tumors from normal tissue.
So how does it work? MARIO uses a combination of pixel-level, polygon-level, box-level, scribble-level, and point-level annotations to train its deep learning model. Each type of annotation provides different levels of detail, allowing the model to learn more nuanced patterns in the data.
For example, pixel-level annotations provide detailed information about the shape and texture of tumors, while polygon-level annotations offer a broader view of their location and size. By combining these different types of labels, MARIO can create a more comprehensive understanding of the data and make more accurate predictions.
The researchers also experimented with different loss functions to see how they affected the model’s performance. They found that using a combination of binary cross-entropy loss and uncertainty loss, which takes into account the uncertainty of each annotation, resulted in the best results.
MARIO has several potential applications in medical imaging, including automatic segmentation of tumors, detection of abnormal lesions, and even image-based diagnosis. With its ability to learn from multiple types of labels, it could help doctors make more accurate diagnoses and improve patient outcomes.
Of course, there are still many challenges to overcome before MARIO can be widely adopted in clinical practice. For one thing, the model requires a lot of training data to work effectively, which can be difficult to collect, especially for rare diseases. Additionally, there may be concerns about the accuracy and reliability of the model’s predictions.
Despite these challenges, MARIO represents an important step forward in the development of AI-powered medical imaging tools. By providing doctors with more accurate and reliable diagnostic information, it could help improve patient care and save lives.
Cite this article: “MARIO: A Mixed-Annotation Framework for Accurate Medical Imaging Diagnosis”, The Science Archive, 2025.
Medical Imaging, Deep Learning, Ai, Mario, Mixed-Annotation, Medical Diagnosis, Segmentation, Tumors, Lesions, Annotation







