Meet me at MOCO’19 where I present a workflow for real-time gesture analysis to visualize gesture kinematics features (Velocity, Acceleration, Jerk) from heterogeneous data (Video, Motion Capture and Gesture Annotations) at the same time base
We investigate new ways to understand and to analyze human gesture in a research context applied on co-verbal gesture across language. The research project focuses on the quality of the movement and consider the gesture “pulse of effort.“ The tools designed here provide immersive and interactive explorations of data: users can test hypotheses and embody gesture visualization and descriptors adopting different Frames of Reference using augmented reality. We have conducted an evaluation protocol in the field of linguistics that compares 496 annotated gestures to benchmark the workflow.
In the exhibition “Pause talking / Play gesture”, we propose to interactively explore what is the characteristic of gesture with digital artworks inspired by Augmented Reality, Virtual Reality and Intelligent Objects. Human gesture raises fascinating questions : How we perceive and understand the movement ? How to make visible and tangible the expression, the behaviors ? And what about the expressivity and the emotions in gesture ?
In his book “Mind’s Eye”, Oliver Sacks explores the fundamental facets of human experience, how we represent the world internally when our eyes are closed, and the remarkable, unpredictable ways that our brains find new ways of perceiving that create worlds as complete and rich as the no-longer-visible world. Maurice Merleau-Ponty in the “Eye & Mind” examines how art, specifically painting, displays the act of viewing the world with openness and immersion that is more truly representative of the continuum of existence.
As humans, we use gesture to both to perceive and to act and real-time technologies now allow to reflect this aspect more and more. The artworks presented in the exhibition “Pause talking / Play gesture” are designed to experiment this reflection, participants are invited to experience, to exchange, to interact and to engage in their inner world of gestures.
Artist-performers Nikolaos BELOMATIS Guillaume BERTINET Juan Patricio Di BACCO Patrick DOAN Athina KANELLOPOULOU Anastasiia TERNOVA Yorgos TSAMPOUNARIS Collective VRAC Eva ZHU
Curator-Artists Dominique BOUTET Judith GUEZ Jean-François JEGO Vincent MEYRUEIS