11-756 DESIGN AND IMPLEMENTATION OF SPEECH RECOGNITION SYSTEMS

DESIGN AND IMPLEMENTATION OF SPEECH RECOGNITION SYSTEMS

Instructor: Bhiksha Raj,   co-instructed by Rita Singh and Mosur Ravishankar

COURSE NUMBER--ECE: 18799D LTI: 11756
LTI students can also register for this course as a lab course
Credits:12
Timings:4:30 p.m. -- 5:50 p.m.
Days:Mondays and Wednesdays
Location: GHC 4102

Prerequisites:
Mandatory:  Linear Algebra. Basic Probability Theory.
Recommended:  Signal Processing.
Coding Skills:  This course will require significant programming form the students. Students must be able to program fluently in at least one language (C, C++, Java, Python, LISP, Matlab are all acceptable).


This is a project-based course.
PROJECTS PAGE

Voice recognition systems invoke concepts from a variety of fields including speech production, algebra, probability and statistics, information theory, linguistics, and various aspects of computer science. Voice recognition has therefore largely been viewed as an advanced science, typically meant for students and researchers who possess the requisite background and motivation.

In this course we take an alternative approach. We present voice recognition systems through the perspective of a novice. Beginning from the very simple problem of matching two strings, we present the algorithms and techniques as a series of intuitive and logical increments, until we arrive at a fully functional continuous speech recognition system.

Following the philosophy that the best way to understand a topic is to work on it, the course will be project oriented, combining formal lectures with required hands-on work. Students will be required to work on a series of projects of increasing complexity. Each project will build on the previous project, such that the incremental complexity of projects will be minimal and eminently doable. At the end of the course, merely by completing the series of projects students would have built their own fully-functional speech recognition systems.

Grading will be based on project completion and presentation.


The first class will be on 19th Jan, Wednesday
                                                                                                                        
Class 119 Jan 2011 Introduction Slides
Class 224 Jan 2011 Data capture. Slides
Class 326 Jan 2011 Feature Computation Slides
Class 431 Jan 2011 Dynamic programming for string alignment. Slides Assignment 2
Class 52 Feb 2011 Project presentations: Data capture and feature computation
Class 67 Feb 2011 Dynamic programming for speech recognition Slides
Class 79 Feb 2011 From templates to HMMs Slides
Class 814 Feb 2011 HMMs Slides
Class 916 Feb 2011 Project presentations. Assignment 3
Class 1021 Feb 2011 HMMs continued from class 8 Slides
Class 1123 Feb 2011 No class
Class 1228 Feb 2011 Continuous speech Slides
Class 132 March 2011 Project presentations. Assignment 4
Class 1414 Mar 2011 Grammars Slides
Class 1516 Mar 2011 Backpointer table. Training from continuous speech. Slides
Class 1621 Mar 2011 Project presentations. Assignment 5
Class 1723 Mar 2011 Ngram models. Slides
Class 1828 Mar 2011 Ngram Models 2 Slides
Class 1930 Mar 2011 Class cancelled
Class 204 Apr 2011 Project Presentations Assignment 6
Class 216 Apr 2011 Subword Units Slides
Class 2211 Apr 2011 State tying Slides Assignment 7
Class 2625 Apr 2011 Adaptation Assignment 8