Artificial Intelligence: Representation and Problem Solving
This course is about the theory and practice of Artificial Intelligence. We will study modern techniques for computers to represent task-relevant information and make intelligent (i.e., satisficing or optimal) decisions towards the achievement of goals. The search and problem solving methods are applicable throughout a large range of industrial, civil, medical, financial, robotic, and information systems. We will investigate questions about AI systems such as: how to represent knowledge, how to effectively generate appropriate sequences of actions and how to search among alternatives to find optimal or near-optimal solutions. We will also explore how to deal with uncertainty in the world and how to learn from experience. We will cover the aggregation of conflicting preferences and computational game theory. We will also cover the AI-brain interface. We expect that by the end of the course students will have a thorough understanding of the algorithmic foundations of AI, how probability and AI are closely interrelated, and how automated agents learn. We also expect students to acquire a strong appreciation of the big-picture aspects of developing fully autonomous intelligent agents.
The 381 version is for undergraduates and the 681 version is for MS students.
There are no formal pre-requisites for the course, but students should have previous programming experience (programming assignments will be in Python), as well as general CS background. Please see the instructors if you are unsure whether your background is suitable for the course.
Name | Hours | Location | |
---|---|---|---|
Tuomas Sandholm | sandholm@cs.cmu.edu | Tuesdays 3-4pm (Tuesdays when he lectures) | GHC 9205 |
Tai Sing Lee | tai@cnbc.cmu.edu | Tuesdays 3-4pm (Tuesdays when he lectures) | GHC 7103 |
Noam Brown | noamb@cmu.edu | Tuesdays 4-5 PM | GHC 9225 |
Kevin Yang | kzy@andrew.cmu.edu | Fridays 3-4 PM | GHC 5th Floor Teaching Commons |
William Xiao | williamx@andrew.cmu.edu | Mondays 3-4 PM | GHC 5th Floor Teaching Commons |
Nathan Eliason | eliason@cmu.edu | Wednesdays 11:30-12:30 | GHC 5th Floor Teaching Commons |
Ziyang Wang | ziyangw@andrew.cmu.edu | Wednesdays 12:30-1:30 PM | GHC 5th Floor Teaching Commons |
Dates | Topic | Instructor | Slides | Video | Read |
---|---|---|---|---|---|
8/29 | Introduction | Sandholm | ppt | video | R&N Chapters 1 and 2 |
8/31 | Uninformed Search | Sandholm | ppt | video | R&N Ch. 3.1-3.4 |
9/5 | Constraint Satisfaction Problems (CSPs) | Sandholm | ppt | video | R&N Ch. 6 |
9/7 | Constraint Satisfaction Problems (CSPs) | Sandholm | video | ||
9/12 | Constraint Satisfaction Problems (CSPs) | Sandholm | video | ||
9/14 | Local Search in CSPs, Then Informed Search | Sandholm | pptx (and see end of CSP deck for local search in CSPs) | video | R&N Ch. 3.5-3.7 |
9/19 | Informed Search and Generating Heuristics | Sandholm | video | ||
9/21 | Integer Programming HW1 Out |
Sandholm | pptx | video | |
9/26 | Probabilistic Reasoning | Lee | pptx | video | |
9/28 | Bayes Networks | Lee | pptx | video | |
10/3 | Inference in Bayes Net | Lee | pptx | video | |
10/5 | Deep Belief Net HW1 Due |
Lee | pptx | video | |
10/10 | Deep Belief Net
PROJECT PROPOSALS DUE FOR 15-681 STUDENTS BY THE BEGINNING OF CLASS |
Lee | pptx | video | |
10/12 | MIDTERM | Sandholm & Lee | |||
10/17 | Markov Decision Processes | Lee | pptx | n/a | |
10/18 | HW 2 Out | ||||
10/19 | Markov Decision Processes | Lee | pptx | video | |
10/24 | Reinforcement Learning | Lee | pptx | video | |
10/26 | Supervised Learning | Lee | pptx | n/a | |
10/29 | HW 2 Due | ||||
10/31 | Robotics | Guest Speaker: Howie Choset | video | ||
11/2 | Neural Networks | Lee | pptx | video | |
11/7 | Computational Game Theory: Extensive-form imperfect-information games: Poker | Sandholm / Noam Brown | pptx | video | |
11/9 | Computational Game Theory: Extensive-form imperfect-information games: Poker | Sandholm / Noam Brown | pptx | video | |
11/14 | Computational Game Theory: Extensive-form perfect-information games: Chess, Go | Sandholm | pptx | video | |
11/15 | HW 3 Due | ||||
11/16 | Social Choice and Mechanism Design | Sandholm | ppt | video | |
11/21 | Deep Learning/Computer Vision | Lee | pptx | video | |
11/23 | Thanksgiving | NO CLASS | |||
11/28 | Natural Language Processing | Guest Speaker: Taylor Berg-Kirkpatrick | video | ||
11/30 | NIPS-17 best paper: "Safe and Nested Subgame Solving for Imperfect-Information Games" | Sandholm / Noam Brown | pptx | video | |
12/1 | HW 4 Due | ||||
12/5 | AI and the Brain | Lee | pptx | video | |
12/7 | AI and the Brain | Lee | pptx | video | |
TBD | FINAL PROJECT WRITE-UPS DUE | ||||
12/12 5:30-8:30 PM | FINAL EXAM | Sandholm & Lee | |||
12/15 5-6 PM | Final project presentations (MS students present their 681 projects; optional for 381 students)Room: GHC 7101 | Sandholm & Lee |
There will be four homework assignments. They will involve both written questions and programming assignments. Written questions will involve working through algorithms presented in the class, deriving and proving mathematical results, and critically analyzing material presented in class. Programming assignments will involve writing code in Python to implement various algorithms.
Topic | Files | Due Dates |
---|---|---|
Homework 1 | handout | 10/5 |
Homework 2 | writeup, handout | 10/29 |
Homework 3 | writeup, handout | 11/15 |
Homework 4 | writeup, handout | 12/1 |
Homework is due on autolab by the posted deadline. Assignments submitted past the deadline will incur the use of late days.
You have 6 late days, but cannot use more than 2 late days per homework. No credit will be given for homework submitted more than 2 days after the due date. After your 6 late days have been used you will receive 20% off for each additional day late.
You can discuss the exercises with your classmates, but you should write up your own solutions. If you find a solution in any source other than the material provided on the course website or the textbook, you must mention the source. All homeworks (programming and theoretical) are always submitted individually. Make sure that you include a README file with your andrew id.
Strict honor code with severe punishment for violators. CMU’s academic integrity policy can be found here. You may discuss assignments with other students as you work through them, but writeups must be done alone. No downloading / copying of code or other answers is allowed. If you use a string of at least 5 words from some source, you must cite the source
Students enrolled in 15-681 will also complete a course project. Late days may not be used on the course project. The projects are to be approved by the professors. They can be done individually or in a pair of students. Projects done by a pair of students should be roughly double in scope.
Project proposals are due in hardcopy on 10/5/2017 at the beginning of class. The proposal should be as concrete as possible so it can be evaluated for topical fit, feasibility, and scope. Of the 25% of the grade that comes from the project, 2% will be from the proposal and 23% of the actual project.
We encourage creativity in the projects. Projects could include using one of the algorithms from class on a new application, making a new algorithm, or both. Projects can also inlcude developing a system that uses AI techniques. Typically projects involve programming, but they can also be proving theorems.
Each project must be presented orally and as a paper.
The class includes both a midterm and final exam. The material for the midterm includes all lectures up to (and including) reinforcement learning.
Accommodations for Students with Disabilities:
If you have a disability and have an accommodations letter from the Disability Resources office, we encourage you to discuss your accommodations and needs with us as early in the semester as possible. We will work with you to ensure that accommodations are provided as appropriate. If you suspect that you may have a disability and would benefit from accommodations but are not yet registered with the Office of Disability Resources, we encourage you to contact them at access@andrew.cmu.edu.
Statement of Support for Students’ Health & Well-being
Take care of yourself. Do your best to maintain a healthy lifestyle this semester by eating well, exercising, avoiding drugs and alcohol, getting enough sleep and taking some time to relax. This will help you achieve your goals and cope with stress.
All of us benefit from support during times of struggle. There are many helpful resources available on campus and an important part of the college experience is learning how to ask for help. Asking for support sooner rather than later is almost always helpful.
If you or anyone you know experiences any academic stress, difficult life events, or feelings like anxiety or depression, we strongly encourage you to seek support. Counseling and Psychological Services (CaPS) is here to help: call 412-268-2922 and visit their website at http://www.cmu.edu/counseling/. Consider reaching out to a friend, faculty or family member you trust for help getting connected to the support that can help.
If you have questions about this or your coursework, please let us know. Thank you, and have a great semester.