Learning to move an object by the humanoid robots by using deep reinforcement learning

Abstract

This paper proposes an algorithm for learning to move the desired object by humanoid robots. In this algorithm the semantic segmentation algorithm and Deep Reinforcement Learning (DRL) algorithms are combined. The semantic segmentation algorithm is used to detect and recognize the object be moved. DRL algorithms are used at the walking and grasping steps. Deep Q Network (DQN) is used to walk towards the target object by means of the previously defined actions at the gate manager and the different head positions of the robot. Deep Deterministic Policy Gradient (DDPG) network is used for grasping by means of the continuous actions. The previously defined commands are finally assigned for the robot to stand up turn left side and move forward together with the object. In the experimental setup the Robotis-Op3 humanoid robot is used. The obtained results show that the proposed algorithm has successfully worked. © 2021 Elsevier B.V. All rights reserved.