Emerging Properties in Self-Supervised Vision Transformers
Mathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou, Julien Mairal, Piotr Bojanowski, Armand Joulin
People
Piotr Bojanowski
Postdoctoral Researcher
I am a Post Doctoral Researcher at Facebook AI Research. Before Facebook, I worked on my PhD on Willow team at INRIA Paris and was supervised by Jean Ponce, Cordelia Schmid, Ivan Laptev and Josef Sivic. I graduated from Ecole polytechnique in 2013 and received a Masters Degree in Mathematics, Machine Learning and Computer Vision (MVA). My work focuses on automatic video understanding and related learning problems. More recently, I also started working on sequence modeling and recurrent networks, with applications to language modeling.
Interests
Computer vision, and machine learning
Latest Publications
ICCV - 2021
XCiT: Cross-Covariance Image Transformers
Alaaeldin El-Nouby, Hugo Touvron, Mathilde Caron, Piotr Bojanowski, Matthijs Douze, Armand Joulin, Ivan Laptev, Natalia Neverova, Gabriel Synnaeve, Jakob Verbeek, Hervé Jégou
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr Bojanowski, Armand Joulin
Unsupervised Pre-Training of Image Features on Non-Curated Data
Mathilde Caron, Piotr Bojanowski, Julien Mairal, Armand Joulin
Adaptive Attention Span in Transformers
Sainbayar Sukhbaatar, Edouard Grave, Piotr Bojanowski, Armand Joulin
Training Hybrid Language Models by Marginalizing over Segmentations
Edouard Grave, Sainbayar Sukhbaatar, Piotr Bojanowski, Armand Joulin
