Social Cobots: Anticipatory Decision-Making for Collaborative Robots Incorporating Unexpected Human Behaviors
Abstract
We propose an architecture as a robots decision-making mechanism to anticipate a humans state of mind, and so plan accordingly during a human-robot collaboration task. At the core of the architecture lies a novel stochastic decision-making mechanism that implements a partially observable Markov decision process anticipating a humans state of mind in two-stages. In the first stage it anticipates the humans task related availability, intent (motivation), and capability during the collaboration. In the second, it further reasons about these states to anticipate the humans true need for help. Our contribution lies in the ability of our model to handle these unexpected conditions: 1) when the humans intention is estimated to be irrelevant to the assigned task and may be unknown to the robot, e.g., motivation is lost, another assignment is received, onset of tiredness, and 2) when the humans intention is relevant but the human doesnt want the robots assistance in the given context, e.g., because of the humans changing emotional states or the humans task-relevant distrust for the robot. Our results show that integrating this model into a robots decision-making process increases the efficiency and naturalness of the collaboration.