Mathematical / Computational Foundations for Machine Learning

10-606/607, Fall 2018
School of Computer Science
Carnegie Mellon University


Important Notes

This schedule is tentative and subject to change. Please check back often.

Jump to...

10-606 Schedule

Date Lecture Readings Announcements

Preliminaries

Mon, 27-Aug Lecture 1 : Course Overview
[Slides]

Wed, 29-Aug Lecture 2 : Sets
[Slides]

Fri, 31-Aug (No Recitation)

Mon, 3-Sep No Class: Labor Day

Wed, 5-Sep Lecture 3 : Data Types; Functions
[Slides]

Fri, 7-Sep (No Recitation)

Linear Algebra

Mon, 10-Sep Lecture 4 : Vector spaces; Inner-product spaces; Matrices
[Slides]

Wed, 12-Sep Lecture 5 : Matrices and linear operators; Matrix Memories
[Slides]

HW1 out

Fri, 14-Sep Recitation: HW1 (Abhilasha)

Mon, 17-Sep Lecture 6 : Application: Matrix Memories in High Dimensions; Linear Independence; Rank; Invertability
[Slides]

Wed, 19-Sep Lecture 7 : Spans; Eigenvalues & Eigenvectors; Linear Eqs; Factorizations
[Slides]

Fri, 21-Sep (No Recitation)

HW1 due

Matrix Calculus

Mon, 24-Sep Lecture 8 : Scalar Derivatives; Partial Derivatives; Vector Derivatives
[Slides]

HW2 out (Tue)

Wed, 26-Sep Lecture 9 : Application: Vector Derivatives for Least Squares
[Slides]

Fri, 28-Sep Recitation: HW2 (Abhinav)

Mon, 1-Oct Lecture 10 : Matrix Derivatives; Method of Lagrange Multipliers
[Slides]

HW2 due (Tue)

Probability

Wed, 3-Oct [Quiz 1] (Lecture cancelled)

HW3 out (Thu)

Fri, 5-Oct Lecture 11 : Probability over Events (Watch Geoff Gordon's video lecture)
[Slides] [Video]

Mon, 8-Oct Recitation: HW3 (Abhilasha)

Wed, 10-Oct Lecture 12 : [Quiz 2] Discrete Random Variables; Mean & Variance; Continuous Random Variables; Probability: Factorization (In-person guest lecture by Abhinav)
[Slides]

HW4 out (Thu)

HW3 due

Fri, 12-Oct Recitation: HW4 (Abhinav)

Mon, 15-Oct Lecture 13 : Discrete & Continuous Distributions; Multivariate Distributions; Sampling; Application: Ordinal Regression
[Slides]

HW4 due

Wed, 17-Oct Final Exam 6:30pm - 9:30pm (Posner Hall A35)

Fri, 19-Oct (No Recitation: Mini-I Complete)

10-607 Schedule

Date Lecture Readings Announcements

Logic & Proofs

Mon, 22-Oct Lecture 1 : Course Overview; Logic
[Slides]

Wed, 24-Oct Lecture 2 : Proof Techniques
[Slides]

Fri, 26-Oct (No Class: CMU Presidential Inauguration)

Mon, 29-Oct Lecture 3 : Proof Techniques; Perceptron Algorithm
[Slides]

HW-A out

Wed, 31-Oct Lecture 4 : Application: Perceptron Mistake Bound
[Slides]

Fri, 2-Nov Recitation: HW-A (Abhilasha)

Computation

Mon, 5-Nov Lecture 5 : Computational Complexity
[Slides]

Wed, 7-Nov Lecture 6 : Asymtotic Analysis Proofs
[Slides]

HW-B out

HW-A due

Fri, 9-Nov (No Recitation)

Mon, 12-Nov Lecture 7 : Recursion; Proofs by Induction
[Slides]

Wed, 14-Nov Lecture 8 : Proofs of Computational Complexity; Proofs of Program Correctness; Dynamic Programming
[Slides]

Fri, 16-Nov Recitation: HW-B (Abhinav)

Mon, 19-Nov Lecture 9 : Data Structures for ML Algorithms
[Slides]

HW-B due (Tue)

Wed, 21-Nov No Class: Thanksgiving Break

Fri, 23-Nov No Class: Thanksgiving Break

Mon, 26-Nov Lecture 10 : [Quiz A] Application: Factor Graphs
[Slides]

HW-C out

Wed, 28-Nov Lecture 11 : Application: Variable Elimination; Profiling ML Algorithms
[Slides]

Fri, 30-Nov Recitation: HW-C / HW-D (Abhilasha / Abhinav)

Optimization

Mon, 3-Dec Lecture 12 : Unconstrained Optimization
[Slides]

HW-D out

HW-C due

Wed, 5-Dec Lecture 13 : [Quiz B] (Guest Lecture) Constrained Optimization

Fri, 7-Dec (No Recitation)

HW-D due

Thu, 13-Dec Final Exam 5:30 PM - 8:30 PM (Wean 7500)