COURSE NUMBER | -- | ECE: 18799D | LTI: 11756 |
Credits: | 12 | |
Timings: | 4:30 p.m. -- 5:50 p.m. | |
Days: | Mondays and Wednesdays | |
Location: | GHC 4101 | |
Prerequisites: |
Mandatory: Linear Algebra. Basic Probability Theory. |
Recommended: Signal Processing. |
Coding Skills: This course will require significant programming form the students. Students must be able to program fluently in at least one language (C, C++, Java, Python, LISP, Matlab are all acceptable). |
PROJECTS PAGE |
Voice recognition systems invoke concepts from a variety of fields including speech production, algebra, probability and statistics, information theory, linguistics, and various aspects of computer science. Voice recognition has therefore largely been viewed as an advanced science, typically meant for students and researchers who possess the requisite background and motivation.
In this course we take an alternative approach. We present voice recognition systems through the perspective of a novice. Beginning from the very simple problem of matching two strings, we present the algorithms and techniques as a series of intuitive and logical increments, until we arrive at a fully functional continuous speech recognition system.
Following the philosophy that the best way to understand a topic is to work on it, the course will be project oriented, combining formal lectures with required hands-on work. Students will be required to work on a series of projects of increasing complexity. Each project will build on the previous project, such that the incremental complexity of projects will be minimal and eminently doable. At the end of the course, merely by completing the series of projects students would have built their own fully-functional speech recognition systems.
In this edition of the course we will also introduce the theory of Weighted Finite State transducers. In the latter half of the course students will learn to build their own WFST systems, and use open-source tools to compose their own WFST recoginzers.
Grading will be based on project completion and presentation.
Class 1 | 23 Jan 2012 | Introduction | Slides | ||
Class 2 | 25 Jan 2012 | Data capture | Slides | assignment 1a | |
Class 3 | 30 Jan 2012 | Feature Computation | Slides | assignment 1b | |
Class 4 | 1 Feb 2012 | Dynamic programming for string alignment. | Slides | assignment 2 | |
Class 5 | 6 Feb 2012 | Finite state automata (John McDonough) | Slides | ||
Class 6 | 8 Feb 2012 | Assignment 1 presentations | |||
Class 7 | 13 Feb 2012 | DTW to recognize speech | Slides | ||
Class 8 | 15 Feb 2012 | Assignment 2 presentations | assignment 3 | ||
Class 9 | 20 Feb 2012 | DTW to HMMs, part 1 | Slides | ||
Class 10 | 22 Feb 2012 | HMMs | Slides | ||
Class 11 | 27 Feb 2012 | Assignment 3 presentations | assignment 4 | ||
Class 12 | 29 Feb 2012 | Continuous speech | Slides | ||
Class 13 | 5 Mar 2012 | Grammars | Slides | ||
Class 14 | 7 Mar 2012 | Backpointer tables, training with continuous speech | Slides | ||
Class 15 | 19 Mar 2012 | Project Presentations | assignment 5 | ||
Class 16 | 21 Mar 2012 | Ngrams | Slides | assignment 6 | |
Class 17 | 26 Mar 2012 | FSA, John M. | Slides | John's syllabus | |
Class 18 | 28 Mar 2012 | FSA, part 2, John M. | Slides | ||
Class 19 | 2 Apr 2012 | Class canceled (instructor sick) | |||
Class 20 | 4 Apr 2012 | Ngrams, part 2 | Slides | ||
Class 21 | 9 Apr 2012 | FSA, part 3, John M. | Slides | ||
Class 22 | 11 Apr 2012 | Subword units | Slides | ||
Class 23 | 16 Apr 2012 | Subword units, part 2 | Slides | ||
Class 24 | 18 Apr 2012 | Parameter sharing | Slides | ||
Class 25 | 23 Apr 2012 | Homework presentations | Slides | assignment 7 | assignment 8 |