Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model
Yuming Du, Robin Kips, Albert Pumarola, Sebastian Starke, Ali Thabet, Artsiom Sanakoyeu
NeurIPS Workshop in Machine Learning for Creativity and Design
In home decoration, an artwork with a particular combination of colors can convey a positive mood that improves psychological health. In our work, we leverage emotion to color mapping techniques and Generative Adversarial Networks (GANs) to generate artwork that brings a room into a more positive mood. We create a unique workflow to extract the color scheme from a room photo, convert it to an image with target colors that represent the desired positive mood, and then use a conditional GAN to generate artwork with fine control of the color. In this paper, we share our emotion to color mapping pipeline, GAN model training, and evaluation results on the generated artworks.
Yuming Du, Robin Kips, Albert Pumarola, Sebastian Starke, Ali Thabet, Artsiom Sanakoyeu
Bilge Acun, Benjamin Lee, Fiodar Kazhamiaka, Kiwan Maeng, Manoj Chakkaravarthy, Udit Gupta, David Brooks, Carole-Jean Wu
Ilkan Esiyok, Pascal Berrang, Katriel Cohn-Gordon, Robert Künnemann