Course Description

Machine learning studies the question "how can we build computer programs that automatically improve their performance through experience?" This includes learning to perform many types of tasks based on many types of experience. For example, it includes robots learning to better navigate based on experience gained by roaming their environments, medical decision aids that learn to predict which therapies work best for which diseases based on data mining of historical health records, and speech recognition systems that lean to better understand your speech based on experience listening to you.This course is designed to give PhD students a thorough grounding in the methods, theory, mathematics and algorithms needed to do research and applications in machine learning. The topics of the course draw from from machine learning, from classical statistics, from data mining, from Bayesian statistics and from information theory. Students entering the class with a pre-existing working knowledge of probability, statistics and algorithms will be at an advantage, but the class has been designed so that anyone with a strong numerate background can catch up and fully participate. If you are interested in this topic, but are not a PhD student, or are a PhD student not specializing in machine learning, you might consider the master's level course on Machine Learning, 10-601."

Textbook

Grading

The requirements of this course consist of participating in lectures, midterm and final exams, 4 problem sets and a project. This is a PhD level class, and the most important thing for us is that by the end of this class students understand the basic methodologies in machine learning, and be able to use them to solve real problems of modest complexity. The grading breakdown is the following:

  • Homework (4 assignments, 30%)
  • Midterm (20%)
  • Final exam (20%)
  • Final project (30%)

Exams

  • Rescheduling of exams:  It is impossible for us to accommodate individual requests to reschedule the exams. It is your responsibility to assure that you are in town and available for the final exam.

Auditing

To satisfy the auditing requirement, you must either:
  • Do *two* homeworks, and get at least 75% of the points in each; or
  • Take the final, and get at least 50% of the points; or
  • Do a class project
    • Like any class project, it must address a topic related to machine learning and you must have started the project while taking this class (can't be something you did last semester). You will need to submit a project proposal with everyone else, and present a poster with everyone. You don't need to submit a milestone or final paper. You must get at least 80% on the poster presentation part of the project.
Please, send the instructors an email saying that you will be auditing the class and what you plan to do.

Homework resources and collaboration policy

Homeworks and exams may contain material that has been covered by papers and webpages. Since this is a graduate class, we expect students to want to learn and not google for answers.

Homeworks will be done individually: each student must hand in their own answers. It is acceptable, however, for students to collaborate in figuring out answers and helping each other solve the problems. We will be assuming that, as participants in a graduate course, you will be taking the responsibility to make sure you personally understand the solution to any work arising from such collaboration. You also must indicate on each homework with whom you collaborated.

The final project may be completed by small teams.

Late homework policy

  • You will be allowed 2 total late days without penalty for the entire semester.  You may be late by 1 day on two different homeworks or late by 2 days on one homework. Once those days are used, you will be penalized according to the following policy:
    • Homework is worth full credit at the beginning of class on the due date.
    • It is worth half credit for the next 48 hours.
    • It is worth zero credit after that.
  • You must turn in at least n-1 of the n homeworks, even if for zero credit, in order to pass the course.
  • Turn in all late homework assignments to Michelle Martin. For those who have to submit homework at weekends, email assignment to 10701-instructors@cs

Homework regrades policy

If you feel that we have made an error in grading your homework, please turn in your homework with a written explanation to  Michelle Martin and we will consider your request. Please note that regrading of a homework may cause your grade to go up or down.

 

Note to people outside CMU

Please feel free to reuse any of these course materials that you find of use in your own courses.  We ask that you retain any copyright notices, and include written notice indicating the source of any materials you use.

© 2012 Eric Xing @ School of Computer Science, Carnegie Mellon University
[validate xhtml]