Project Peregrine

I am extremely passionate to introduce Peregrine - an incarnation of our neural framework Falcon and is targeted towards neural generative models for speech. We want to build a super strong software stack for research at CMU. As part of this, Peregrine addresses Speech Synthesis, Voice Conversion, Speech Enhancement, Source Separation and Speech Coding.

Architectures

  • Tacotron (May 2019)

  • WaveNet (June 2019)

  • VQVAE (July 2019)

  • Clockwork Hierarchical VAE (August 2019)



Samples (updated per checkpoint so that its easier to see how training progresses)

Text to Speech Synthesis with Tacotron (Character level)