Understanding Human Reactions to Robotic Failures: The REFLEX Dataset

Thursday 27 March 2025


Researchers have created a massive dataset of human reactions to robotic failures and explanations, providing a valuable resource for developing more robust and adaptable human-robot interactions.


The dataset, known as REFLEX, includes over 55 participants who interacted with a robot designed to perform tasks such as picking up objects and placing them on a shelf. The robot was programmed to fail in various ways, including picking up the wrong object or dropping an object, and then provide explanations for these failures.


Researchers tracked the participants’ reactions to these failures, using a range of methods including facial recognition software, speech analysis, and body language detection. They also recorded the participants’ emotions and attention levels throughout the interaction.


The resulting dataset is a treasure trove of information on how humans respond to robotic failures and explanations. It reveals that people tend to react more negatively to failures that are caused by the robot’s own actions, rather than external factors such as the environment or other objects. For example, if the robot picks up an object it was not supposed to, participants were more likely to express frustration and disappointment.


The dataset also shows that explanations can have a significant impact on how people perceive and respond to robotic failures. When the robot provides a clear and concise explanation for its failure, participants are more likely to forgive the robot and continue interacting with it. However, when the explanation is unclear or confusing, participants may become even more frustrated and less inclined to interact with the robot.


The REFLEX dataset has significant implications for the development of human-robot interaction systems. It highlights the importance of designing robots that can effectively communicate and explain their actions, as well as providing clear and concise feedback to users when things go wrong.


Furthermore, the dataset provides a valuable resource for researchers who are working on developing machine learning models that can detect and respond to human emotions and attention levels. By analyzing the data from REFLEX, these researchers can develop more accurate and effective models that can improve the overall quality of human-robot interactions.


Overall, the REFLEX dataset is an important step forward in our understanding of how humans interact with robots, and it has significant potential for improving the design and development of human-robot interaction systems.


Cite this article: “Understanding Human Reactions to Robotic Failures: The REFLEX Dataset”, The Science Archive, 2025.


Human-Robot Interaction, Robot Failure, Explanation, Facial Recognition, Speech Analysis, Body Language Detection, Emotions, Attention Levels, Machine Learning, Human Factors


Reference: Parag Khanna, Andreas Naoum, Elmira Yadollahi, Mårten Björkman, Christian Smith, “REFLEX Dataset: A Multimodal Dataset of Human Reactions to Robot Failures and Explanations” (2025).


Leave a Reply