Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling
Hongyu Gong, Yun Tang, Juan Miguel Pino, Xian Li
People
Xian Li
Research Scientist
I am a research scientist working on Machine Translation at Facebook AI. I earned my PhD at Rensselaer Polytechnic Institute (RPI) advised by James Hendler. Prior to Facebook, I have worked on a variety of machine learning problems at Stitch Fix, Google and Morgan Stanley.
Interests
Natural language processing, neural machine translation, multi-lingual models, few shot / zero shot learning
Latest Publications
NeurIPS - 2021
Gender Bias Amplification During Speed-Quality Optimization in Neural Machine Translation
Adithya Renduchintala, Denise Diaz, Kenneth Heafield, Xian Li, Mona Diab
FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task
Yun Tang, Hongyu Gong, Xian Li, Changhan Wang, Juan Pino, Holger Schwenk, Naman Goyal
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task
Yun Tang, Juan Pino, Xian Li, Changhan Wang, Dmitriy Genzel
Addressing Posterior Collapse with Mutual Information for Improved Variational Neural Machine Translation
Arya D. McCarthy, Xian Li, Jiatao Gu, Ning Dong
Cross-lingual Retrieval for Iterative Self-Supervised Training
Chau Tran, Yuqing Tang, Xian Li, Jiatao Gu