11-755 MLSP

11-755 MACHINE LEARNING FOR SIGNAL PROCESSING

(ECE number: 18-797)

Instructor: Bhiksha Raj

This course is an elective in LTI, MLD and ECE
Credits: 12
Timings: 4.30-5.50pm, Tuesdays and Thursdays
Location: Porter Hall 125C
Instructor office hours: Monday 3.00pm-4.00pm
TA Manuel Tragut office hours: Friday 3.00pm-4.00pm, Porter Hall A22
TA Anoop Ramakrishna office hours: Thursday 12.30pm-1.30pm, Porter Hall A19
Instructor office hours: Monday 3.00-4.00

Prerequisites:
Mandatory:  Linear Algebra. Basic Probability Theory.
Recommended:  Signal Processing. Machine Learning.

Please sign up to the MLSP-fall-2011 google group to participate in dicussions and receive notices.


Signal Processing is the science that deals with extraction of information from signals of various kinds. This has two distinct aspects -- characterization and categorization. Traditionally, signal characterization has been performed with mathematically-driven transforms, while categorization and classification are achieved using statistical tools.

Machine learning aims to design algorithms that learn about the state of the world directly from data.

A increasingly popular trend has been to develop and apply machine learning techniques to both aspects of signal processing, often blurring the distinction between the two.

This course discusses the use of machine learning techniques to process signals. We cover a variety of topics, from data driven approaches for characterization of signals such as audio including speech, images and video, and machine learning methods for a variety of speech and image processing problems.

Students from the previous iterations (2009 2010) worked on a number of excellent projects, several of which were submitted to conferences. This year we hope to continue this tradition.

A list of potential projects for the fall 2011 edition of the course may be found here.

The planned course schedule will appear here shortly.

There will be several guest lectures. These will be announced as dates are finalized.

Grading will be based on performance in course assignments and a final project.


Class 1, 29 Aug 2011 Introduction. Representing Sounds and Images. Slides, Handout
Class 2, 1 Sep 2011 Introduction to Linear Algebra Slides, Handout,
Class 3, 6 Sep 2011 Introduction to Linear Algebra II Slides, Handout, Homework 1
Class 4, 8 Sep 2011 Project ideas
Class 5, 13 Sep 2011 DSP refresher: data parameterization Slides, Handout Additional material
Class 6, 15 Sep 2011 Eigen representations: Eigen faces Slides, Handout
Class 7, 20 Sep 2011 Detecting faces in images Slides, Handout
Class 8, 22 Sep 2011 EM Slides, Handout
27 Sep 2011 No Class Homework 2
Class 9, 29 Sep 2011 Probabilistic Latent Component Analysis Slides, Handout
4 Oct 2011 Speech Synthesis (Alan Black) slides
6 Oct 2011 PLCA / LVA 2 slides handouts
11 Oct 2011 Shift-invariant decompositions slides
13 Oct 2011 Component Analysis (Fernando de la Torre) slides
18 Oct 2011 Clustering slides handout
20 Oct 2011 Clustering slides handout Homework 3
10 Nov 2011 Biometrics: IRIS (Marios Savvides) slides handout