Kaizen: Continuously Improving Teacher Using Exponential Moving Average For Semi-supervised Speech Recognition
Vimal Manohar, Tatiana Likhomanenko, Qiantong Xu, Wei-Ning Hsu, Ronan Collobert, Yatharth Saraf, Geoffrey Zweig, Abdelrahman Mohamed
People
Ronan Collobert
Research Lead
I joined Facebook in September 2014, as a Research Scientist in the AI Research Group. In the previous past four years I was a researcher at the Idiap Research Institute in Switzerland, leading the Applied Machine Learning group. Previously, I have spent six years at NEC Labs in Princeton, NJ. My current interests are around deep learning in general, with applications in natural language, image and speech processing. I also hack Torch (a machine learning library) on my free time. I received my PhD from University of Pierre & Marie Curie in Paris, while achieving it under the supervision of the Bengio brothers (Idiap in Swizterland, and University of Montreal).
Interests
Natural language processing, computer vision, speech recognition, software for machine learning
Latest Publications
IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) - 2021
slimIPL: Language-Model-Free Iterative Pseudo-Labeling
Tatiana Likhomanenko, Qiantong Xu, Jacob Kahn, Gabriel Synnaeve, Ronan Collobert
Word-level Speech Recognition with a Letter to Word Encoder
Ronan Collobert, Awni Hannun, Gabriel Synnaeve
Libri-light: A benchmark for ASR with limited or no supervision
Jacob Kahn, Morgan Rivière, Weiyi Zheng, Evgeny Kharitonov, Qiantong Xu, Pierre-Emmanuel Mazaré, Julien Karadayi, Vitaliy Liptchinsky, Ronan Collobert, Christian Fuegen, Tatiana Likhomanenko, Gabriel Synnaeve, Armand Joulin, Abdelrahman Mohamed, Emmanuel Dupoux
Scaling up online speech recognition using ConvNets
Vineel Pratap, Qiantong Xu, Jacob Kahn, Gilad Avidov, Tatiana Likhomanenko, Awni Hannun, Vitaliy Liptchinsky, Gabriel Synnaeve, Ronan Collobert
wav2vec: Unsupervised Pre-training for Speech Recognition
Steffen Schneider, Alexei Baevski, Ronan Collobert, Michael Auli