Accurate Assembly Progress Estimation Using Deep Metric Learning and Anomaly Detection

Monday 03 March 2025


Researchers have made a significant breakthrough in developing a system that can accurately estimate the progress of assembly work, even when faced with occlusion caused by workers or other obstacles. The innovative approach uses deep metric learning to classify images and identify the steps involved in the assembly process.


The system is designed to detect objects in the image, crop them out, and then use a classification method based on deep metric learning to estimate the progress of the work. This involves setting up anchor samples, positive samples, and negative samples, and then using a loss function that increases the distance between the anchor sample and the negative sample while decreasing the distance between the anchor sample and the positive sample.


To make the system more robust, researchers have also developed an anomaly detection method that can recognize images that cannot be estimated due to occlusion. This is achieved by adding noise to some or all of the objects in the image, making it impossible to correctly determine the step. The system then learns to identify these noisy samples and adjust its estimates accordingly.


The results of the study are impressive, with an accuracy rate of 82.9% for estimating the progress of assembly work using the proposed Anomaly Triplet-Net method. This is a significant improvement over traditional methods that rely on object detection alone.


The system has also been tested in real-world scenarios, where it was able to successfully estimate the progress of assembly work despite occlusion caused by workers or other obstacles. The results show that the system is not only accurate but also robust and reliable.


One of the key benefits of this system is its ability to recognize progress between steps, rather than just at specific points. This allows for more precise estimates of the assembly process and can help manufacturers improve their production efficiency and reduce errors.


The researchers believe that this technology has the potential to revolutionize the manufacturing industry by providing a more accurate and efficient way to monitor and control assembly processes. They plan to continue refining the system and exploring its applications in other areas, such as quality inspection and maintenance scheduling.


Overall, this study demonstrates the power of deep learning in solving complex problems and improving real-world applications. The innovative approach to estimating assembly progress has the potential to make a significant impact on industries that rely heavily on manual labor and assembly work.


Cite this article: “Accurate Assembly Progress Estimation Using Deep Metric Learning and Anomaly Detection”, The Science Archive, 2025.


Assembly, Progress Estimation, Deep Metric Learning, Anomaly Detection, Occlusion, Object Detection, Manufacturing, Production Efficiency, Error Reduction, Quality Inspection.


Reference: Takumi Kitsukawa, Kazuma Miura, Shigeki Yumoto, Sarthak Pathak, Alessandro Moro, Kazunori Umeda, “Anomaly Triplet-Net: Progress Recognition Model Using Deep Metric Learning Considering Occlusion for Manual Assembly Work” (2025).


Leave a Reply