Edge AI System Combines Deep Learning and Active Inference for Real-Time Object Detection and Planning

Thursday 06 March 2025


Deep learning-based object detection has made tremendous strides in recent years, enabling real-time recognition of objects in images and videos. However, these models often require significant computational resources, making them unsuitable for deployment on edge devices such as smart cameras and robots.


A new approach, published in a recent research paper, aims to change this by integrating deep learning-based perception with active inference planning on edge devices. The result is a system that not only detects objects but also adapts its focus dynamically to optimize information gathering and exploration.


The system consists of two main components: a deep learning-based object detection module and an active inference planning module. The former uses YOLOv10, a popular and efficient object detection algorithm, to identify objects in images and videos. The latter employs active inference principles to plan the next actions based on the detected objects and the environment.


Active inference is a probabilistic framework that models the agent’s (in this case, the edge device) uncertainty about its surroundings and adjusts its behavior accordingly. By minimizing free energy, the system reduces uncertainty and optimizes information gain. In the context of object detection, active inference planning allows the system to focus on areas of interest, such as detected objects, and adjust its field of view dynamically.


The researchers deployed their system on an Nvidia Jetson Orin Nano NX, a powerful edge AI platform designed for accelerated machine learning tasks. The results were impressive: the perception module processed frames at 45 FPS, while the planning module operated at 4 FPS. The overall system demonstrated real-time performance, adapting to changing environments and detecting objects with high accuracy.


The potential applications of this technology are vast. In surveillance scenarios, the system could optimize camera placement and focus to detect specific objects or individuals in crowded areas. In robotics, it could enable autonomous agents to adapt their exploration strategies based on detected objects and environmental changes.


While there is still much work to be done, this research marks an important step towards developing more efficient and adaptive edge AI systems. By integrating deep learning-based perception with active inference planning, the system demonstrates a new approach to edge computing that can potentially revolutionize various fields, from robotics and surveillance to smart cities and beyond.


Cite this article: “Edge AI System Combines Deep Learning and Active Inference for Real-Time Object Detection and Planning”, The Science Archive, 2025.


Edge Ai, Object Detection, Active Inference, Deep Learning, Edge Devices, Real-Time Processing, Surveillance, Robotics, Smart Cities, Machine Learning.


Reference: Devendra Vyas, Miguel de Prado, Tim Verbelen, “Towards smart and adaptive agents for active sensing on edge devices” (2025).


Leave a Reply