Computer Science > Artificial Intelligence
[Submitted on 8 Oct 2017 (v1), last revised 15 Dec 2019 (this version, v6)]
Title:Recurrent Deterministic Policy Gradient Method for Bipedal Locomotion on Rough Terrain Challenge
View PDFAbstract:This paper presents a deep learning framework that is capable of solving partially observable locomotion tasks based on our novel interpretation of Recurrent Deterministic Policy Gradient (RDPG). We study on bias of sampled error measure and its variance induced by the partial observability of environment and subtrajectory sampling, respectively. Three major improvements are introduced in our RDPG based learning framework: tail-step bootstrap of interpolated temporal difference, initialisation of hidden state using past trajectory scanning, and injection of external experiences learned by other agents. The proposed learning framework was implemented to solve the Bipedal-Walker challenge in OpenAI's gym simulation environment where only partial state information is available. Our simulation study shows that the autonomous behaviors generated by the RDPG agent are highly adaptive to a variety of obstacles and enables the agent to effectively traverse rugged terrains for long distance with higher success rate than leading contenders.
Submission history
From: Doo Re Song [view email][v1] Sun, 8 Oct 2017 22:38:34 UTC (1,809 KB)
[v2] Fri, 19 Jan 2018 10:12:48 UTC (1,723 KB)
[v3] Sun, 6 May 2018 16:54:06 UTC (2,614 KB)
[v4] Sat, 11 Aug 2018 09:55:39 UTC (2,665 KB)
[v5] Thu, 13 Sep 2018 08:40:02 UTC (2,622 KB)
[v6] Sun, 15 Dec 2019 11:03:01 UTC (3,265 KB)
Current browse context:
cs.AI
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.