Please use this identifier to cite or link to this item:
https://doi.org/10.21256/zhaw-23823
Publication type: | Article in scientific journal |
Type of review: | Peer review (publication) |
Title: | Customizing skills for assistive robotic manipulators, an inverse reinforcement learning approach with error-related potentials |
Authors: | Batzianoulis, Iason Iwane, Fumiaki Wei, Shupeng Correia, Carolina Gaspar Pinto Ramos Chavarriaga, Ricardo Millán, José del R. Billard, Aude |
et. al: | No |
DOI: | 10.1038/s42003-021-02891-8 10.21256/zhaw-23823 |
Published in: | Communications Biology |
Volume(Issue): | 4 |
Issue: | 1406 |
Issue Date: | 16-Dec-2021 |
Publisher / Ed. Institution: | Nature Publishing Group |
ISSN: | 2399-3642 |
Language: | English |
Subject (DDC): | 006: Special computer methods 621.3: Electrical, communications, control engineering |
Abstract: | Robotic assistance via motorized robotic arm manipulators can be of valuable assistance to individuals with upper-limb motor disabilities. Brain-computer interfaces (BCI) offer an intuitive means to control such assistive robotic manipulators. However, BCI performance may vary due to the non-stationary nature of the electroencephalogram (EEG) signals. It, hence, cannot be used safely for controlling tasks where errors may be detrimental to the user. Avoiding obstacles is one such task. As there exist many techniques to avoid obstacles in robotics, we propose to give the control to the robot to avoid obstacles and to leave to the user the choice of the robot behavior to do so a matter of personal preference as some users may be more daring while others more careful. We enable the users to train the robot controller to adapt its way to approach obstacles relying on BCI that detects error-related potentials (ErrP), indicative of the user’s error expectation of the robot’s current strategy to meet their preferences. Gaussian process-based inverse reinforcement learning, in combination with the ErrP-BCI, infers the user’s preference and updates the obstacle avoidance controller so as to generate personalized robot trajectories. We validate the approach in experiments with thirteen able-bodied subjects using a robotic arm that picks up, places and avoids real-life objects. Results show that the algorithm can learn user’s preference and adapt the robot behavior rapidly using less than five demonstrations not necessarily optimal. |
URI: | https://digitalcollection.zhaw.ch/handle/11475/23823 |
Fulltext version: | Published version |
License (according to publishing contract): | CC BY 4.0: Attribution 4.0 International |
Departement: | School of Engineering |
Organisational Unit: | Centre for Artificial Intelligence (CAI) |
Appears in collections: | Publikationen School of Engineering |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
2021_Batzianoulis-etal_Customizing-skills-assistive-robotic-manipulators.pdf | 2.37 MB | Adobe PDF | View/Open |
Show full item record
Batzianoulis, I., Iwane, F., Wei, S., Correia, C. G. P. R., Chavarriaga, R., Millán, J. d. R., & Billard, A. (2021). Customizing skills for assistive robotic manipulators, an inverse reinforcement learning approach with error-related potentials. Communications Biology, 4(1406). https://doi.org/10.1038/s42003-021-02891-8
Batzianoulis, I. et al. (2021) ‘Customizing skills for assistive robotic manipulators, an inverse reinforcement learning approach with error-related potentials’, Communications Biology, 4(1406). Available at: https://doi.org/10.1038/s42003-021-02891-8.
I. Batzianoulis et al., “Customizing skills for assistive robotic manipulators, an inverse reinforcement learning approach with error-related potentials,” Communications Biology, vol. 4, no. 1406, Dec. 2021, doi: 10.1038/s42003-021-02891-8.
BATZIANOULIS, Iason, Fumiaki IWANE, Shupeng WEI, Carolina Gaspar Pinto Ramos CORREIA, Ricardo CHAVARRIAGA, José del R. MILLÁN und Aude BILLARD, 2021. Customizing skills for assistive robotic manipulators, an inverse reinforcement learning approach with error-related potentials. Communications Biology. 16 Dezember 2021. Bd. 4, Nr. 1406. DOI 10.1038/s42003-021-02891-8
Batzianoulis, Iason, Fumiaki Iwane, Shupeng Wei, Carolina Gaspar Pinto Ramos Correia, Ricardo Chavarriaga, José del R. Millán, and Aude Billard. 2021. “Customizing Skills for Assistive Robotic Manipulators, an Inverse Reinforcement Learning Approach with Error-Related Potentials.” Communications Biology 4 (1406). https://doi.org/10.1038/s42003-021-02891-8.
Batzianoulis, Iason, et al. “Customizing Skills for Assistive Robotic Manipulators, an Inverse Reinforcement Learning Approach with Error-Related Potentials.” Communications Biology, vol. 4, no. 1406, Dec. 2021, https://doi.org/10.1038/s42003-021-02891-8.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.