AERE504: Syllabus
Fall Semester 2019
Reading should be done after the associated lecture. Demonstrations during the lecture will be done in the Julia language using IJulia notebooks.
| Date | Topic | Reading | Due |
| Aug. 27 | Overview | DMU 1 | |
| Aug. 29 | Probabilistic Representations | DMU 2.1 | |
| Sept. 3 | Probabilistic Inference | DMU 2.2 | |
| Sept. 5 | Parameter Learning | DMU 2.3 | |
| Sept. 10 | Structure Learning | DMU 2.4 | |
| Sept. 12 | Midterm 1 Problem Review Session | | |
| Sept. 17 | Midterm 1 (in class) | | |
| Sept. 19 | Decision Theory and Games | DMU 3.1-3.3 | |
| Sept. 24 | Markov Decision Processes | DMU 4.1-4.4 | Project 1 |
| Sept. 26 | Approximate Dynamic Programming | DMU 4.5-4.7 | |
| Oct. 1 | Exploration and Exploitation | DMU 5.1 | |
| Oct. 3 | Model-Based Reinforcement Learning | DMU 5.2-5.3 | |
| Oct. 8 | Model-Free Reinforcement Learning | DMU 5.4-5.5 | |
| Oct. 10 | Deep Reinforcement Learning | | |
| Oct. 15 | State Uncertainty | DMU 6.1-6.2 | |
| Oct. 17 | Exact POMDP Methods | DMU 6.3 | Project 2 |
| Oct. 22 | Offline POMDP Methods | DMU 6.4 | Proposal |
| Oct. 24 | Online POMDP Methods | DMU 6.5 | |
| Oct. 29 | Midterm 2 Problem Review Session | | |
| Oct. 31 | Midterm 2 (in class) | | |
| Nov. 5 | Deep Reinforcement Learning for Autonomous Aircraft Routing (Xuxi Yang) | | |
| Nov. 7 | MDP for Air Traffic Management (Guodong Zhu) (Take-home Exam Release) | | |
| Nov. 12 | Selected topic in Reinforcement Learning | | |
| Nov. 14 | Selected topic in Reinforcement Learning | | |
| Nov. 19 | Selected topic in Reinforcement Learning | | Take-home Exam |
| Nov. 21 | Selected topic in Reinforcement Learning | | |
| Nov. 26 | Thanksgiving Break | | |
| Nov. 28 | Thanksgiving Break | | |
| Dec. 3 | Selected topic in Reinforcement Learning | | |
| Dec. 5 | Selected topic in Reinforcement Learning | | |
| Dec. 10 | No Class | | Final Project Paper |
| Dec. 12 | No Class | | Peer Review
|
|