CS 295: Optimal Control and Reinforcement Learning, Winter 2020

General information

  • Time: Tuesdays and Thursdays, 3:30–4:50pm
  • Location: Physical Sciences Classroom Building (PSCB) 240
  • Instructor: Prof. Roy Fox
    • Office hours: Fridays 9–11am, DBH 4064
  • Announcements and forum: Piazza Class

Resources

Schedule

(subject to changes)

Week Tuesday Thursday
(1) Jan 6 Introduction Imitation learning
(2) Jan 13 Optimal control Stochastic optimal control
(3) Jan 20 Planning
Assignment 1 due
Temporal-difference methods
(4) Jan 27 Partial observability RL with function approximation
(5) Feb 3 Policy-gradient methods Advanced deep RL methods
(6) Feb 10 Actor–critic methods Model-based methods
(7) Feb 17 Inverse RL Control as inference
(8) Feb 24 Structured control Multi-task and meta-learning
(9) Mar 2 – Super Tuesday – Exploration
(10) Mar 9 RL systems Open problems

Assignments