Computer graphics · Human motion · Virtual reality

Researching how people move, interact and learn.

I study how human movement can be captured, described and translated into interactive virtual environments.

Abstract study of human motionLayered movement paths and joint positions representing captured motion.MOTION / TIMESIMONSENECAL.ORG
01Motion as data. Interaction as context.

01 / Publications

Publications

Peer-reviewed work and doctoral research in motion analysis, computer graphics and human–computer interaction.

Download all BibTeX
  1. Virtual salsa instructor demonstrating a mambo pattern
    2020Doctoral thesis

    Learning and understanding partner dance through motion analysis in a virtual environment

    Simon Senecal

    Doctoral thesis, University of Geneva, 2020

    A framework for describing partner dance through measurable motion features and applying them to virtual learning systems.

    PDF at UNIGE DOI
    BibTeX +
    @phdthesis{Senecal2020Thesis,
      author = {Senecal, Simon},
      title = {Learning and understanding partner dance through motion analysis in a virtual environment},
      school = {University of Geneva},
      year = {2020},
      doi = {10.13097/archive-ouverte/unige:142477},
      url = {https://archive-ouverte.unige.ch/unige:142477}
    }
    Abstract +

    Partner dance is a physical activity that is social and involves two partners dancing to music. Learning such dance is difficult and presents many challenges, such as finding a partner and learning the right skills. Through the motion analysis of couples as entities with regards to tempos, we aim at developing new ways to understand and characterize partner dance. We propose a set of features that can extract high-level information from low-level data and help design learning systems. First, we selected three main dance skills considered important for Salsa dance learning from interviews with experts - Rhythm, Guidance, and Styling - and searched for clues in the theoretical description of movement that could describe high-level dance skills through low-level motion measurements. We then suggest a set of musical-related motion features to characterize Salsa performance in terms of learning levels. Second, a database was created with 26 couples from three levels of experience performing to ten songs with varying tempos. The extracted features were submitted to machine-learning algorithms, with Random Forest achieving up to 90% accuracy for level classification. Finally, we designed and evaluated an interactive virtual-reality dance-learning system with a virtual partner and hand-to-hand interaction. Motion analysis using the proposed features and Laban Movement Analysis showed improved dance skills after training. Overall, the approach is relevant both for classifying learning states and improving dance skills in an immersive virtual-reality environment.

  2. A participant dancing beside a virtual salsa instructor
    2020Journal article

    Salsa dance learning evaluation and motion analysis in gamified virtual reality environment

    Simon Senecal, Niels A. Nijdam, Andreas Aristidou and Nadia Magnenat-Thalmann

    Multimedia Tools and Applications 79(33–34), 24621–24643

    An evaluation of a virtual-reality learning application using motion analysis across dancers and non-dancers.

    Download PDF DOI
    BibTeX +
    @article{Senecal2020SalsaVR,
      author = {Senecal, Simon and Nijdam, Niels A. and Aristidou, Andreas and Magnenat-Thalmann, Nadia},
      title = {Salsa dance learning evaluation and motion analysis in gamified virtual reality environment},
      journal = {Multimedia Tools and Applications},
      volume = {79},
      number = {33-34},
      pages = {24621--24643},
      year = {2020},
      doi = {10.1007/s11042-020-09192-y}
    }
    Abstract +

    Learning couple dances such as salsa is challenging, as it requires all dance skills - guidance, rhythm, and style - to be understood and assimilated correctly. In this paper, we propose an interactive virtual-reality learning game designed to improve salsa dancing skills. Its components include a virtual partner with interactive control, visual and haptic feedback, and dance tasks. The application was tested with 20 regular dancers and 20 non-dancers. Learning was evaluated through Musical Motion Features and Laban Movement Analysis before and after training. Both frameworks showed the profile of non-dancers converging toward that of regular dancers, validating the learning process and informing future work in motion analysis, couple-dance learning, and human-human interaction.

  3. 2019Conference paper

    Classification of Salsa Dance Level using Music and Interaction based Motion Features

    Simon Senecal, Niels A. Nijdam and Nadia Magnenat-Thalmann

    VISIGRAPP 2019, vol. 1: GRAPP, pp. 100–109

    Music- and interaction-based features used to classify couple performances across three learning levels.

    Download PDF DOI
    BibTeX +
    @inproceedings{Senecal2019SalsaLevel,
      author = {Senecal, Simon and Nijdam, Niels A. and Magnenat-Thalmann, Nadia},
      title = {Classification of Salsa Dance Level using Music and Interaction based Motion Features},
      booktitle = {Proceedings of VISIGRAPP 2019 - Volume 1: GRAPP},
      pages = {100--109},
      year = {2019},
      publisher = {SCITEPRESS},
      doi = {10.5220/0007399701000109},
      isbn = {978-989-758-354-4}
    }
    Abstract +

    Learning couple dances such as salsa requires dancers to assimilate and understand many parameters. This paper proposes music- and interaction-based motion features for classifying salsa-couple performance into three learning states: beginner, intermediate, and expert. The features were derived from interviews with teachers and professionals and from a systematic review of dance research. A motion-capture database of 26 couples across three skill levels was recorded at ten tempos, producing 260 clips. Twenty-seven motion features were computed over sliding eight-beat windows and evaluated using k-nearest neighbours, Random Forest, and Support Vector Machine classifiers. Classification accuracy reached 81% for three levels and 92% for two levels, while feature analysis validated 23 of the 27 proposed features.

  4. Nine frames of motion-captured salsa partners
    2018Conference paper

    Motion analysis and classification of salsa dance using music-related motion features

    Simon Senecal, Niels A. Nijdam and Nadia Magnenat-Thalmann

    Proceedings of ACM Motion, Interaction and Games 2018

    A motion-feature model derived from musical data and three-dimensional recordings of 26 dancing couples.

    Download PDF DOI
    BibTeX +
    @inproceedings{Senecal2018SalsaMotion,
      author = {Senecal, Simon and Nijdam, Niels A. and Magnenat-Thalmann, Nadia},
      title = {Motion analysis and classification of salsa dance using music-related motion features},
      booktitle = {Proceedings of the 11th ACM SIGGRAPH Conference on Motion, Interaction and Games},
      pages = {1--10},
      year = {2018},
      publisher = {ACM},
      doi = {10.1145/3274247.3274514},
      isbn = {978-1-4503-6015-9}
    }
    Abstract +

    Learning couple dances such as salsa requires dancers to assimilate and understand many parameters. This paper proposes a set of music-related motion features for describing, analysing, and classifying salsa couples according to learning state: beginner, intermediate, or expert. The dance qualities were identified through a systematic review cross-linked with interviews with teachers and professionals. The features were extracted from musical data and three-dimensional dancer movement using a newly proposed algorithm. A motion-capture database was recorded from 26 couples of varying skill levels dancing at ten tempos, producing 260 clips. The resulting analysis and classification validate several proposed music-related motion features and provide insight into others.

  5. Activation and pleasure model used for emotion recognition
    2016Journal article

    Continuous body emotion recognition system during theater performances

    Simon Senecal, Louis Cuel, Andreas Aristidou and Nadia Magnenat-Thalmann

    Computer Animation and Virtual Worlds 27(3–4), 311–320

    A continuous emotion-recognition system based on whole-body dynamics and Laban Movement Analysis.

    Download PDF DOI
    BibTeX +
    @article{Senecal2016Emotion,
      author = {Senecal, Simon and Cuel, Louis and Aristidou, Andreas and Magnenat-Thalmann, Nadia},
      title = {Continuous body emotion recognition system during theater performances},
      journal = {Computer Animation and Virtual Worlds},
      volume = {27},
      number = {3-4},
      pages = {311--320},
      year = {2016},
      doi = {10.1002/cav.1714}
    }
    Abstract +

    Understanding emotional human behaviour in its multimodal and continuous form is necessary for studying human-machine interaction and creating consistent social agents. We propose a system for continuously recognizing emotional behaviour expressed during communication through gesture and whole-body dynamics. Motion features inspired by Laban Movement Analysis are mapped onto the Russell Circumplex Model. Theater performance provides a case study that emphasizes expressive body motion. Using a trained neural network and annotated data, the system describes motion behaviour over time as trajectories on the Russell Circumplex Model. This work contributes to understanding human behaviour and expression and is a first step toward a complete continuous emotion-recognition system that also incorporates facial expressions.

02 / Motion dataset

In preparation

A rare motion-capture database of partner salsa.

A research corpus of 26 couples—from beginner to expert—performing at ten tempos. Recorded in 3D at 120 Hz, it contains 260 motion clips for studying rhythm, interaction and dance skill.

Coming soon — the database, schema and access documentation are being prepared for release.

Couples
26
Motion clips
260
Capture rate (Hz)
120
Dance tempos
10

03 / Background

Physics, engineering and computer graphics.

PhD, Computer Science

University of Geneva · MIRALab

Supervised by Prof. Nadia Magnenat-Thalmann.

MSc, Art & Science

Grenoble Institute of Technology

BSc, Physics

Université Paris-Sud

04 / Contact

Discuss research, collaboration or applied work.