DASH
Repository logo
Communities & Collections
Browse DASH
DASH Stories
Statistics
  1. Home
  2. Faculty of Arts and Sciences
  3. FAS Theses and Dissertations
  4. Optimal control and reinforcement learning in simple physical systems

Optimal control and reinforcement learning in simple physical systems

Open/View files
Thesis.pdf (4.06 MB)
Date
May 11, 2023
Author(s)
Davenport, Ian
The Harvard community has made this article openly available. Please share how this access benefits you.
Citation
Davenport, Ian. 2023. Optimal control and reinforcement learning in simple physical systems. Doctoral dissertation, Harvard University Graduate School of Arts and Sciences.
Abstract
Motor control is a ubiquitous theme in the natural world and its richness demands we approach it from several directions. Alongside the challenge of understanding perception and coordinated muscular activation we need to account for the fact that all motion takes place in a body embedded in a dynamic environment. Inspired by extreme feats of athletic and animal performance we bring together ideas from physics and optimization to approach problems in motor control. First we study the Estonian sport Kiiking and show how to augment basic physical models to account for physiological limitations. We use methods from both optimal control theory and reinforcement learning to understand optimal strategies in the sport and compare our findings to observations. Next we describe an approach for the control of gliding flight by dynamically changing the shape of the gliding body. We compare strategies that are time optimal to those which require the least control input. Finally we use elasticity theory to understand the mechanics of snakes as they traverse large vertical gaps. After describing our data analysis procedure we detail the optimal control problem we formulated to understand the posture of the animals as they complete their ascent.
Terms of Use
This article is made available under the terms and conditions applicable to Other Posted Material (LAA), as set forth at Terms of Service
URI
https://nrs.harvard.edu/URN-3:HUL.INSTREPOS:37375821
Subjects

Physics

Collection
FAS Theses and Dissertations
Metrics
Repository logo
  • CONTACT US
  • OSRDS
  • ABOUT DASH
  • DEPOSITING TO DASH
  • TERMS OF USE
  • REQUEST A WAIVER
  • TAKE DOWN POLICY
  • NAME CHANGE POLICY
  • HARVARD OA POLICIES
  • DASH SUBMITTER AGREEMENT
  • Accessibility
  • Privacy
Creative Commons License BY
Creative Commons Attribution 4.0 International License

Except where otherwise noted, this work is subject to a Creative Commons Attribution 4.0 International License,
which allows anyone to share and adapt our material as long as proper attribution is given.
For details and exceptions, see the Harvard Library Copyright Policy
©2024 Presidents and Fellows of Harvard College.