Understanding Dimensional Collapse in Contrastive Self-supervised Learning
Li Jing, Pascal Vincent, Yann LeCun, Yuandong Tian
People
Research Scientist
I am a Research Scientist at Meta AI Research (FAIR) in Montreal, as well as an Associate Professor in the Department of Computer Science and Operations Research at Université de Montréal, a founding member of the Montreal Institute for Learning Algorithms (MILA) and Associate Fellow in the Canadian Institute for Advanced Research (CIFAR / Learning Machines and Brains program).
I have been conducting research on artificial neural networks since 1995 and completed a PhD in computer-science/machine-learning at Université de Montréal under the direction of Yoshua Bengio in 2004. My primary research focus is the development of original approaches for representation learning that aim to be both statistically and computationally efficient, in order to enable the learning of more meaningful and practically useful representations across multiple application domains such as vision and language understanding.
AI, machine learning, image and language understanding, and optimization.
Li Jing, Pascal Vincent, Yann LeCun, Yuandong Tian
Jure Zbontar, Florian Knoll, Anuroop Sriram, Tullie Murrell, Zhengnan Huang, Matthew J. Muckley, Aaron Defazio, Ruben Stern, Patricia Johnson, Mary Bruno, Marc Parente, Krzysztof J. Geras, Joe Katsnelson, Hersh Chandarana, Zizhao Zhang, Michal Drozdzal, Adriana Romero, Mike Rabbat, Pascal Vincent, Nafissa Yakubova, James Pinkerton, Duo Wang, Erich Owens, Larry Zitnick, Michael P. Recht, Daniel K. Sodickson, Yvonne W. Lui
Ahmed Touati, Amy Zhang, Joelle Pineau, Pascal Vincent
Avishek Joey Bose, Gauthier Gidel, Hugo Berard, Andre Cianflone, Pascal Vincent, Simon Lacoste-Julien, William L. Hamilton
Dzmitry Bahdanau, Tom Bosc, Stanislaw Jastrzebski, Edward Grefenstette, Pascal Vincent, Yoshua Bengio
Nicolas Loizou, Hugo Berard, Alexia Jolicoeur-Martineau, Pascal Vincent, Simon Lacoste-Julien, Ioannis Mitliagkas