Efficient and Adaptive Continual Learning for Medical Image Segmentation

Tuesday 08 April 2025


The quest for a medical imaging segmentation model that can adapt to new tasks without forgetting old ones has long been an elusive goal in the field of computer vision. Now, researchers have made significant strides towards achieving this feat by developing a dynamically evolving segment anything model (EvoSAM) capable of continuous learning.


Traditional approaches to medical image segmentation rely on pre-training models on large datasets and then fine-tuning them for specific tasks. However, these methods often struggle with catastrophic forgetting, where the model forgets previously learned information when adapting to new tasks. EvoSAM addresses this issue by incorporating a novel incremental ridge regression approach that allows the model to learn from new tasks without compromising its performance on previous ones.


The core innovation of EvoSAM lies in its ability to incrementally update its parameters during the learning process, rather than relying solely on fine-tuning. This is achieved through a least squares framework, which combines the cumulative statistics of the model’s output with the statistics of the input data. By doing so, EvoSAM can adapt to new tasks while preserving its knowledge of previous ones.


The researchers evaluated EvoSAM on two challenging medical image segmentation tasks: surgical blood vessel segmentation and multi-site prostate MRI segmentation. The results show that EvoSAM outperforms traditional approaches in both tasks, demonstrating its ability to learn from new data without forgetting previously learned information.


One of the key advantages of EvoSAM is its flexibility. Unlike other models that require extensive retraining or fine-tuning for each new task, EvoSAM can adapt to new tasks with minimal additional training data. This makes it an attractive solution for real-world medical imaging applications where data is often limited and diverse.


The researchers also explored the use of user-provided box prompts to guide the model’s attention during segmentation. These prompts allow clinicians to specify the region of interest in the image, enabling EvoSAM to focus on specific areas and improve its accuracy. This feature has significant implications for medical imaging applications where precise segmentation is crucial for diagnosis and treatment planning.


While EvoSAM shows promise as a dynamic and adaptable medical imaging segmentation model, there are still challenges to be addressed. For instance, the researchers acknowledge that the model’s performance can degrade when faced with drastically different data distributions or tasks. Addressing these issues will require further research and development.


Despite these challenges, the potential benefits of EvoSAM are substantial. By enabling continuous learning and adaptation, this model has the potential to revolutionize medical imaging applications, from surgical planning to disease diagnosis.


Cite this article: “Efficient and Adaptive Continual Learning for Medical Image Segmentation”, The Science Archive, 2025.


Medical Imaging, Segmentation Model, Continuous Learning, Catastrophic Forgetting, Ridge Regression, Incremental Learning, Least Squares Framework, Surgical Planning, Disease Diagnosis, Machine Learning.


Reference: Zhaori Liu, Mengyang Li, Hu Han, Enli Zhang, Shiguang Shan, Zhiming Zhao, “Dynamically evolving segment anything model with continuous learning for medical image segmentation” (2025).


Leave a Reply