Generative Model for Skeletal Human Movements Based on Conditional DC-GAN Applied to Pseudo-Images - CAO et robotique (CAOR)
Article Dans Une Revue Algorithms Année : 2020

Generative Model for Skeletal Human Movements Based on Conditional DC-GAN Applied to Pseudo-Images

Wang Xi
Guillaume Devineau
  • Fonction : Auteur
  • PersonId : 1084316
Fabien Moutarde
Jie Yang
  • Fonction : Auteur
  • PersonId : 1084317

Résumé

Generative models for images, audio, text, and other low-dimension data have achieved great success in recent years. Generating artificial human movements can also be useful for many applications, including improvement of data augmentation methods for human gesture recognition. The objective of this research is to develop a generative model for skeletal human movement, allowing to control the action type of generated motion while keeping the authenticity of the result and the natural style variability of gesture execution. We propose to use a conditional Deep Convolutional Generative Adversarial Network (DC-GAN) applied to pseudo-images representing skeletal pose sequences using tree structure skeleton image format. We evaluate our approach on the 3D skeletal data provided in the large NTU_RGB+D public dataset. Our generative model can output qualitatively correct skeletal human movements for any of the 60 action classes. We also quantitatively evaluate the performance of our model by computing Fréchet inception distances, which shows strong correlation to human judgement. To the best of our knowledge, our work is the first successful class-conditioned generative model for human skeletal motions based on pseudo-image representation of skeletal pose sequences.
Fichier principal
Vignette du fichier
algorithms-13-00319.pdf (5.66 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03039879 , version 1 (04-12-2020)

Identifiants

Citer

Wang Xi, Guillaume Devineau, Fabien Moutarde, Jie Yang. Generative Model for Skeletal Human Movements Based on Conditional DC-GAN Applied to Pseudo-Images. Algorithms, 2020, 13 (12), pp.319. ⟨10.3390/a13120319⟩. ⟨hal-03039879⟩
146 Consultations
310 Téléchargements

Altmetric

Partager

More