Category Archives: Immersion

2019-10-10 MOCO’19 Paper & Demo – Tempe, Az, USA

Meet me at MOCO’19 where I present a workflow for real-time gesture analysis to visualize gesture kinematics features (Velocity, Acceleration, Jerk) from heterogeneous data (Video, Motion Capture and Gesture Annotations) at the same time base

PAPER: J.-F. Jégo, V. Meyrueis, D. Boutet. A Workflow for Real-time Visualization and Data Analysis of Gesture using Motion Capture. In Proceedings of Movement and Computing conference, Tempe, AZ, USA, October 2019 (MOCO ’19) , 6 pages, ACM, New-York, USA, 2019

We investigate new ways to understand and to analyze human gesture in a research context applied on co-verbal gesture across language. The research project focuses on the quality of the movement and consider the gesture “pulse of effort.“ The tools designed here provide immersive and interactive explorations of data: users can test hypotheses and embody gesture visualization and descriptors adopting different Frames of Reference using augmented reality. We have conducted an evaluation protocol in the field of linguistics that compares 496 annotated gestures to benchmark the workflow.

2019-05-28 Pause Talking Play Gesture! – Frankfurt, Germany

Exhibition Pause Talking / Play Gesture!

In the exhibition “Pause talking / Play gesture”, we propose to interactively explore what is the characteristic of gesture with digital artworks inspired by Augmented Reality, Virtual Reality and Intelligent Objects. Human gesture raises fascinating questions : How we perceive and understand the movement ? How to make visible and tangible the expression, the behaviors ? And what about the expressivity and the emotions in gesture ?

In his book “Mind’s Eye”, Oliver Sacks explores the fundamental facets of human experience, how we represent the world internally when our eyes are closed, and the remarkable, unpredictable ways that our brains find new ways of perceiving that create worlds as complete and rich as the no-longer-visible world. Maurice Merleau-Ponty in the “Eye & Mind” examines how art, specifically painting, displays the act of viewing the world with openness and immersion that is more truly representative of the continuum of existence.

As humans, we use gesture to both to perceive and to act and real-time technologies now allow to reflect this aspect more and more. The artworks presented in the exhibition “Pause talking / Play gesture” are designed to experiment this reflection, participants are invited to experience, to exchange, to interact and to engage in their inner world of gestures.

Guillaume BERTINET
Juan Patricio Di BACCO
Patrick DOAN
Anastasiia TERNOVA
Collective VRAC

Dominique BOUTET
Judith GUEZ
Jean-François JEGO

Free Opening
Gräfin-Dönhoff building, room GD 102
Europaplatz 1, 15230 Frankfurt (Oder)

More info: