CS 175: Project in Artificial Intelligence

Fall 2021

Course logistics

  • When: Tuesdays and Thursdays at 2–3:20pm
    • Lectures during the first couple of weeks will introduce reinforcement learning and suggested project platforms.
      • Some of these lectures will be in-person and some virtual; please see the schedule below for the planned (subject to change) location of each lecture.
      • These lectures are optional. This page will list online introductory resources.
    • After the introductory lectures, project teams will meet separately at times they will schedule.
    • Each team will meet with the instructor at least every other week.
      • Most virtual meetings will be during Tuesday and Thursday class hours.
      • Other time slots, including in-person ones, will also be available.
    • During week 10, the class will meet again for teams to present their projects.
    • There will be no discussion section meetings.
  • Where:
  • Announcements and forum: ed discussion
    • Important course announcements will be made on the forum.
    • Please post on the forum, publicly or privately, all course-related questions.
    • Please do not email course staff, except for personal matters unrelated to the course.
  • Assignments: gradescope
    • Assignments will be uploaded to this page.
  • Teams, reports, and grades: canvas
  • Instructor: Prof. Roy Fox
    • Office hours: calendly
    • Enrolled students are welcome to:
      • Schedule 15-minute slots (more than once if needed);
      • Give at least 4-hour notice;
      • All team members are expected to attend project meetings.
  • Teaching assistant: Kolby Nottingham

Grading policy

  • Assignments: 10% (individual)
    • Late submission: 3 grace days total, for both assignments, per person
  • Project proposal: 10% (team)
  • Progress report: 20% (team)
  • Final report: 40% (team + individual component)
    • Late submission: 4 grace days total, for all project submissions, per team
  • Project presentation: 15% (team)
  • Participation (in-class, on-forum, evaluations): 5% (individual)
  • No exams

Schedule

(p.) = in-person; (v.) = virtual

(Week) Dates Tuesday Thursday
(0) Sep 23 Introduction (p.)
Prof. Singh's videos:
(1) Sep 28, 30 Reinforcement Learning (p.)
Prof. Singh's videos: 		Platforms (videos)
Malmo:
DuckieTown:
ColosseumRL:
(2) Oct 5, 7 Projects (v.)
Prof. Singh's videos: 		Deep Reinforcement Learning (p.)
Prof. Singh's videos:
(3) Oct 12, 14 Project meetings
Assignment 1 due 		Project meetings
Project proposal due
(4) Oct 19, 21 Project meetings Project meetings
(5) Oct 26, 28 Project meetings
Assignment 2 due 		Project meetings
(6) Nov 2, 4 Project meetings Project meetings
(7) Nov 9, 11 Project meetings -- Veterans Day --
(8) Nov 16, 18 Project meetings
Progress report due		 Project meetings
(9) Nov 23, 25 Project meetings -- Thanksgiving --
(10) Nov 30, Dec 2 Project presentations (hybrid) Project presentations (hybrid)
(11) Dec 9 Project report due

Note: the planned schedule is subject to change.

Assignments

  • Assignment 1; due Tuesday, October 12, 2021 (Pacific Time).
  • Assignment 2; due Tuesday, October 26, 2021 (Pacific Time).

Resources

Projects
Platforms
RL tutorials
RL libraries
Courses
Books