CS 295: Optimal Control and Reinforcement Learning, Winter 2020

General information

  • Time: Tuesdays and Thursdays, 3:30–4:50pm
  • Location: Physical Sciences Classroom Building (PSCB) 240
  • Instructor: Prof. Roy Fox
    • Office hours: Fridays 9–11am, DBH 4064
  • Announcements and forum: Piazza Class

Resources

Schedule

(subject to changes)

Week Tuesday Thursday
(1) Jan 6 Introduction Imitation learning
(2) Jan 13 Optimal control Stochastic optimal control
(3) Jan 20 Temporal-difference methods Policy-gradient methods
Assignment 1 due
(4) Jan 27 Actor–critic methods Advanced deep RL methods
(5) Feb 3 Planning
Assignment 2 due
Model-based methods
(6) Feb 10 Partial observability Exploration
Assignment 3 due
(7) Feb 17 Inverse RL Control as inference
(8) Feb 24 Structured control
Assignment 4 due
Multi-task and meta-learning
(9) Mar 2 – Super Tuesday – Multi-agent systems
(10) Mar 9 RL systems
Assignment 5 due
Open problems

Assignments