Closing the Reality Gap with Unsupervised Sim-to-Real Image Translation
Authors:
Jan Blumenkamp,
Andreas Baude,
Tim Laue
Abstract:
Deep learning approaches have become the standard solution to many problems in computer vision and robotics, but obtaining sufficient training data in high enough quality is challenging, as human labor is error prone, time consuming, and expensive. Solutions based on simulation have become more popular in recent years, but the gap between simulation and reality is still a major issue. In this pape…
▽ More
Deep learning approaches have become the standard solution to many problems in computer vision and robotics, but obtaining sufficient training data in high enough quality is challenging, as human labor is error prone, time consuming, and expensive. Solutions based on simulation have become more popular in recent years, but the gap between simulation and reality is still a major issue. In this paper, we introduce a novel method for augmenting synthetic image data through unsupervised image-to-image translation by applying the style of real world images to simulated images with open source frameworks. The generated dataset is combined with conventional augmentation methods and is then applied to a neural network model running in real-time on autonomous soccer robots. Our evaluation shows a significant improvement compared to models trained on images generated entirely in simulation.
△ Less
Submitted 15 June, 2021; v1 submitted 4 November, 2019;
originally announced November 2019.
Kick Motions for the NAO Robot using Dynamic Movement Primitives
Authors:
Arne Böckmann,
Tim Laue
Abstract:
In this paper, we present the probably first application of the popular \emph{Dynamic Movement Primitives (DMP)} approach to the domain of soccer-playing humanoid robots. DMPs are known for their ability to imitate previously demonstrated motions as well as to flexibly adapt to unforeseen changes to the desired trajectory with respect to speed and direction. As demonstrated in this paper, this mak…
▽ More
In this paper, we present the probably first application of the popular \emph{Dynamic Movement Primitives (DMP)} approach to the domain of soccer-playing humanoid robots. DMPs are known for their ability to imitate previously demonstrated motions as well as to flexibly adapt to unforeseen changes to the desired trajectory with respect to speed and direction. As demonstrated in this paper, this makes them a useful approach for describing kick motions. Furthermore, we present a mathematical motor model that compensates for the NAO robot's motor control delay as well as a novel minor extension to the DMP formulation. The motor model is used in the calculation of the Zero Moment Point (ZMP), which is needed to keep the robot in balance while kicking. All approaches have been evaluated on real NAO robots.
△ Less
Submitted 2 June, 2016;
originally announced June 2016.
