Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model
Yuming Du, Robin Kips, Albert Pumarola, Sebastian Starke, Ali Thabet, Artsiom Sanakoyeu
AES International Conference on Audio for Virtual and Augmented Reality (AVAR)
The capture and reproduction of spatial audio is becoming increasingly important with the mushrooming of applications in teleconferencing, entertainment, and virtual reality. Two popular methods include High Order Ambisonics (HOA) and beamforming-based binaural reproduction (BFBR), which are mainly studied with spherical arrays. Recently, binaural signal matching (BSM) has been proposed for binaural reproduction with arbitrary arrays. This paper investigates improvement of the method, which is based on a model of the sound field separated into direct and reverberant parts. A simulation study shows that the proposed method improved the performance of the BSM algorithm for some tested acoustic scenarios without the need for additional information about the sound field.
Yuming Du, Robin Kips, Albert Pumarola, Sebastian Starke, Ali Thabet, Artsiom Sanakoyeu
Bilge Acun, Benjamin Lee, Fiodar Kazhamiaka, Kiwan Maeng, Manoj Chakkaravarthy, Udit Gupta, David Brooks, Carole-Jean Wu
Ilkan Esiyok, Pascal Berrang, Katriel Cohn-Gordon, Robert Künnemann