Foundations of Autonomous Decision Making under Uncertainty

10-734, Fall 2024

Aarti Singh


Home Lectures Homeworks Project

Lecture:

Date and Time: Tuesday and Thursday, 9:30 - 10:50 am
Location: GHC 4211

Office Hours:
  • Aarti Singh (Instructor), by appointment, GHC 8207
  • Yuda Song (TA), Wednesday 1-2pm, GHC 8007

Course Description:

AI is increasingly being used not only for prediction but for decision making in the real-world. Algorithms for autonomous decision making need to rely on the uncertainty of predictions, in addition to accuracy, to identify potentially good decisions that may not have been tried. This course will cover foundations of AI algorithms used for making decisions in the face of uncertainty starting from stochastic experimental design and Gaussian process optimization to advanced methods for sequential decisions such as bandits, online learning, active learning, and reinforcement learning. We will discuss these methods, analysis techniques, their sample and computational complexities, as well as open challenges related to these methods.

Prerequisites: 10-701 or 10-715, 10-716

Recommended Textbooks:
Grading:
  • Homeworks (45%)
  • Project (40%)
  • Scribing (10%)
  • Educational Study (5%)