Advancing Human-Robot Handover with Scalable Synthetic Datasets

Tuesday 04 March 2025


The quest for a seamless human-robot handover has been an ongoing challenge in robotics research. The complexity of this task lies in its multi-faceted nature, requiring precise control over both robotic arm and base movements while ensuring safety and adaptability to various scenarios. A recent development in this field presents a significant step forward, demonstrating the potential for a scalable and safe human-to-mobile-robot handover system.


The researchers’ approach hinges on the creation of diverse synthetic datasets, generated using a scalable pipeline that simulates full-body human motion. This allows for the training of an imitation learning framework that can accurately predict coordinated base-arm actions. The policy’s output is used to solve inverse kinematics and compute joint positions for the robotic arm.


One of the key innovations lies in the automatic method for producing safe, imitation-friendly demonstrations. This process involves generating full-body robot grasping poses offline and ranking them based on distance from the human hand. The assumption is that a grasping pose farther from the human hand will result in a safer full-body pose when the robot faces the human.


The system’s performance was evaluated through extensive simulation experiments, showcasing its ability to generalize across different scenarios, including healthcare settings and home office environments. The results demonstrate significant improvements over baseline methods, with an average success rate of 77.8% compared to 58.7% for the best competing method.


To further validate the approach, real-world demonstrations were conducted using a Galbot robot, featuring a 3-DoF omnidirectional base and a 7-DoF robotic arm. The system was evaluated by five individuals across six objects in both simple and complex settings, with our method consistently outperforming the baseline.


The researchers acknowledge certain limitations of their approach, including the need for customized measures to accommodate different robot types and potential solutions for real-world deployment challenges such as occlusion errors or inaccuracies in depth camera perception. Nevertheless, this development marks a significant milestone towards the realization of a human-to-mobile-robot handover system that can adapt to various scenarios while ensuring safety and efficiency.


The scalability of the pipeline for generating diverse synthetic datasets is particularly noteworthy, as it enables the creation of large-scale, high-quality training data without relying on real-world demonstrations. This approach has far-reaching implications for robotics research, enabling the development of more sophisticated policies that can generalize across different scenarios and environments.


Cite this article: “Advancing Human-Robot Handover with Scalable Synthetic Datasets”, The Science Archive, 2025.


Robotics, Handover, Human-Robot Interaction, Imitation Learning, Synthetic Datasets, Scalability, Safety, Inverse Kinematics, Mobile Robots, Robot Grasping


Reference: Zifan Wang, Ziqing Chen, Junyu Chen, Jilong Wang, Yuxin Yang, Yunze Liu, Xueyi Liu, He Wang, Li Yi, “MobileH2R: Learning Generalizable Human to Mobile Robot Handover Exclusively from Scalable and Diverse Synthetic Data” (2025).


Leave a Reply