Differences and similarities between reinforcement learning and the classical optimal control framework. Issue 1 (18th November 2019)

• Record Type: Journal Article
• Authors: Gottschalk, Simon; Burger, Michael
• Other Names: Eberhardsteiner J. guestEditor.; Schöberl M. guestEditor.
• Is Part Of: Proceedings in applied mathematics and mechanics. Volume 19:Issue 1(2019)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2019-11-18
• Subjects: Applied mathematics -- Periodicals; Engineering mathematics -- Periodicals; Mathematical physics -- Periodicals; 519
• DOI: 10.1002/pamm.201900390
• Languages: English
• ISSNs: 1617-7061

Abstract

Abstract: In this contribution, we discuss Reinforcement Learning as an alternative way to solve optimal control problems. Especially for biomechanical models, well‐established classical techniques can become complex and time‐consuming, because biomechanical models have often much more actuators than degrees of freedom. Furthermore, the solution of such a technique is normally only applicable to this specific setting. This means, that a slightly change of the initial value of the model or the desired end position does make the computed solution useless. We give a short overview to Reinforcement Learning and apply it to an optimal control problem containing the above mentioned challenges. We use an algorithm, which updates the weights and biases of a neural network, which takes the role of a controller, using simulated trajectories of the model generated by the current neural network.