Anticipatory Bayesian Policy Selection for Online Adaptation of Collaborative Robots to Unknown Human Types

Abstract

As a key component of collaborative robots (cobots) working with humans, existing decision-making approaches try to model the uncertainty in human behaviors as latent variables. However, as more possible contingencies are covered by such intention-aware models, they face slow convergence times and less accurate responses. For this purpose, we present a novel anticipatory policy selection mechanism built on existing intention-aware models, where a robot is required to choose from an existing set of policies based on an estimate of the human. Each of these intention-aware robot models anticipates and adapts to a different human's short-term changing behaviors. Our contribution is the Anticipatory Bayesian Policy Selection (ABPS) mechanism which selects from a library of different response policies that are generated from such models, and converges to a reliable policy after as few interactions as possible when faced with unknown humans. The selection is based on the estimation of the human in terms of long-term workplace characteristics that we call types, such as level of expertise, stamina, attention and collaborativeness. Our results show that incorporating this policy selection mechanism contributes positively to the efficiency and naturalness of the collaboration, when compared to the best intention-aware model in hindsight running alone.

@inproceedings{Gorur:2019:ABP:3306127.3331677,
 author = {G\"{o}r\"{u}r, O. Can and Rosman, Benjamin and Albayrak, Sahin},
 title = {Anticipatory Bayesian Policy Selection for Online Adaptation of Collaborative Robots to Unknown Human Types},
 booktitle = {Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems},
 series = {AAMAS '19},
 year = {2019},
 isbn = {978-1-4503-6309-9},
 location = {Montreal QC, Canada},
 pages = {77--85},
 numpages = {9},
 url = {http://dl.acm.org/citation.cfm?id=3306127.3331677},
 acmid = {3331677},
 publisher = {International Foundation for Autonomous Agents and Multiagent Systems},
 address = {Richland, SC},
 keywords = {anticipatory policy selection, human type and intent inference, human-robot collaboration, socially collaborative robots},
}
Authors:
Category:
Conference Paper
Year:
2019
Location:
AAMAS'19 - Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems
Link: