Propose a framework based on diffusion models for consistent and realistic long-term novel view synthesis. Diffusion models have achieved impressive performance on many content creation applications, such as image-to-image translation and text-to- image generation.
Recognizing human activities is a decades-old problem in computer vision. With recent advancements in user- assistive augmented reality and virtual reality (AR/VR) systems...
We present the design of a productionized end-to-end stereo depth sensing system that does pre-processing, online stereo rectification, and stereo depth estimation with...
We propose a model, called Cube R-CNN, designed to generalize across camera and scene types with a unified approach. We show that Cube R-CNN outperforms prior works on the larger...
We introduce RoDynRF, an algorithm for reconstructing dynamic radiance fields from casual videos. Unlike existing approaches, we do not require accurate camera poses as input. Our method optimizes camera poses and two radiance fields, modeling static and dynamic elements. Our approach includes a coarse-to-fine strategy and epipolar geometry to exclude moving pixels, deformation fields, time- dependent appearance models, and regularization losses for improved consistency.
We explore egocentric audio-visual object localization task and observe that egomotion commonly exists in first-person recordings and out-of-view sound components can be created.
We propose a transfer method that leverages a model trained on a large source dataset to improve the learning ability on small target datasets.
<palette xmlns:mcrent="palette-mc-research-entity-toolkit" xmlns:mcr="palette-mc-research-toolkit" xmlns:meta-props="meta-props-toolkit" xmlns:meta-config-toolkit="meta-config-toolkit">...
We present the first neural relighting approach for rendering high fidelity personalized hands that can be animated in real-time under novel illumination.
The new archetype represents the set of objects using a set of learn- able embeddings, termed as queries, which are fed to a decoder consisting of a stack of decoding stages.
