Learning Task-independent Joint Control for Robotic Manipulators with Reinforcement Learning and Curriculum Learning

Lars Væhrens*, Daniel Díez Alvarez, Ulrich Berger, Simon Bøgh

*Corresponding author for this work

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

2 Citations (Scopus)

Abstract

We present a deep reinforcement learning-based approach to control robotic manipulators and construct task-independent trajectories for point-to-point motions. The research objective in this work is to learn control in the joint action space, which can be generalized to various industrial manipulators. The approach necessitates that the neural network learns a mapping from joint movements to the reward landscape determined by the distance to the goal and nearby obstacles. In addition, curriculum learning is embedded in this approach to facilitate learning by reducing the complexity of the environment. Conducted experiments demonstrate how the reinforcement learning-based approach can be applied to three different industrial manipulators in simulation with minimal configuration changes. The results of our contribution demonstrate that a model can be trained in a simulation environment, transferred to the real world, and used in complex environments. Furthermore, the Sim2Real transfer, augmented by curriculum learning, highlights that the robots behave in the same way in the real world as in the simulation and that the operations in the real world are safe from a control and trajectory point-of-view.

Original languageEnglish
Title of host publicationIEEE 21st International Conference on Machine Learning and Applications (ICMLA)
EditorsM. Arif Wani, Mehmed Kantardzic, Vasile Palade, Daniel Neagu, Longzhi Yang, Kit-Yan Chan
Number of pages8
PublisherIEEE (Institute of Electrical and Electronics Engineers)
Publication date2023
Pages1250-1257
Article number10068864
ISBN (Print)978-1-6654-6284-6
ISBN (Electronic)978-1-6654-6283-9
DOIs
Publication statusPublished - 2023
EventInternational Conference on Machine Learning and Applications - , Bahamas
Duration: 12 Dec 202214 Dec 2022
Conference number: 21
https://www.icmla-conference.org/icmla22/

Conference

ConferenceInternational Conference on Machine Learning and Applications
Number21
Country/TerritoryBahamas
Period12/12/202214/12/2022
Internet address

Keywords

  • Artificial Intelligence (AI)
  • Curriculum Learning
  • Deep Learning
  • Machine Learning
  • Reinforcement Learning (RL)
  • Robot

Fingerprint

Dive into the research topics of 'Learning Task-independent Joint Control for Robotic Manipulators with Reinforcement Learning and Curriculum Learning'. Together they form a unique fingerprint.

Cite this