Foundations of Autonomous Decision Making under Uncertainty
10-734, Fall 2024
|
|
|
|
|
Lecture:
|
Date and Time: Tuesday and Thursday, 9:30 - 10:50 am
Location: GHC 4211
|
Office Hours:
|
- Aarti Singh (Instructor), by appointment, GHC 8207
- Yuda Song (TA), Wednesday 1-2pm, GHC 8007
|
|
Course Description:
|
AI is increasingly being used not only for prediction but for decision making in the real-world. Algorithms for autonomous decision making need to rely on the uncertainty of predictions, in addition to accuracy, to identify potentially good decisions that may not have been tried. This course will cover foundations of AI algorithms used for making decisions in the face of uncertainty starting from stochastic experimental design and Gaussian process optimization to advanced methods for sequential decisions such as bandits, online learning, active learning, and reinforcement learning. We will discuss these methods, analysis techniques, their sample and computational complexities, as well as open challenges related to these methods.
|
Prerequisites:
|
10-701 or 10-715, 10-716
|
Recommended Textbooks:
|
|
Grading:
|
- Homeworks (45%)
- Project (40%)
- Scribing (10%)
- Educational Study (5%)
|
|
|