Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling
Hongyu Gong, Yun Tang, Juan Miguel Pino, Xian Li
People
Research Scientist
I am a research scientist working on Machine Translation at Facebook AI. I earned my PhD at Rensselaer Polytechnic Institute (RPI) advised by James Hendler. Prior to Facebook, I have worked on a variety of machine learning problems at Stitch Fix, Google and Morgan Stanley.
Natural language processing, neural machine translation, multi-lingual models, few shot / zero shot learning
Hongyu Gong, Yun Tang, Juan Miguel Pino, Xian Li
Adithya Renduchintala, Denise Diaz, Kenneth Heafield, Xian Li, Mona Diab
Yun Tang, Hongyu Gong, Xian Li, Changhan Wang, Juan Pino, Holger Schwenk, Naman Goyal
Yun Tang, Juan Pino, Xian Li, Changhan Wang, Dmitriy Genzel
Arya D. McCarthy, Xian Li, Jiatao Gu, Ning Dong
Chau Tran, Yuqing Tang, Xian Li, Jiatao Gu