I am co-leading the “Grounded Sequence-to-Sequence Transduction” team at the JSALT 2018 workshop. We are building multi-modal systems to do speech recognition, machine translation, and video summarization. This work is somewhat based on Abhinav and Yajie’s ICASSP 2017 best student-paper candidate paper.