CS 295: Optimal Control and Reinforcement Learning, Winter 2020

General information

  • Time: Tuesdays and Thursdays, 3:30–4:50pm
  • Location: Physical Sciences Classroom Building (PSCB) 240
  • Instructor: Prof. Roy Fox
    • Office hours: Fridays 9–11am, DBH 4064
  • Announcements and forum: Piazza Class

Resources

Schedule

(subject to changes)

Week Tuesday Thursday
(1) Jan 6 Introduction Imitation learning
(2) Jan 13 Optimal control Stochastic optimal control
(3) Jan 20 Temporal-difference methods Policy-gradient methods
Assignment 1 due
(4) Jan 27 Actor–critic methods Advanced model-free methods
(5) Feb 3 Planning
Assignment 2 due
Model-based methods
(6) Feb 10 – cancelled – Partial-observability methods
(7) Feb 17 Advanced partial-observability methods
Assignment 3 due
Exploration
(8) Feb 24 Inverse RL Control as inference
(9) Mar 2 Structured control Multi-agent systems
Stephen McAleer
(10) Mar 9 Multi-task learning – cancelled –
Final assignment due

Assignments

Further reading