HUMAINE Summer School 2006 Program and Proceedings

THIRD SUMMER SCHOOL

Casa Paganini, Genova, 22 September-28 September 2006

Thursday 21 September

6h00-8h00 pm

Registration and welcome

Friday 22 September

Workshop on Multimodal Synchronization in Affective Expressions

9h00-9h15 am

Welcome address

9h15-10h30 am

Opening the workshop (Klaus Scherer)

Presentation of the database (Tanja Banziger)

10h30-11h00 am

Coffee break

11h00 am -1h00 pm

Modelling communication with a virtual human

(Ipke Wachsmuth)

1h00-2h30 pm

Lunch

2h30-4h15 pm

Identifying repeated patterns of behaviour in time

(Magnus Magnusson)

4h15-4h30 pm

Coffee break

4h30-5h00 pm

Time warping of a piano (and other) video sequences following different emotions

 (Daniel Arfib)

5h00-5h45 pm

Annotating, extracting and generating synchronized expressive behavior

 (Catherine Pelachaud)

5h45-6h15 pm

Featuring the GEMEP corpus: experiences and future plans

 (Hannes Pirker)

Saturday 23 September

Workshop on Multimodal Synchronization in Affective Expressions

9h00-11h00 am

Demo of the software THEME (Magnus Magnusson)

11h00-11h30 am

Coffee break

11h30 am -12h45 pm

Pattern recognition in peripheral and central signalling

(Thierry Pun)

12h45-2h30 pm

Lunch

2h30-4h00 pm

Modelling discrete changes in continuous dynamical systems

(Rene te Boekhorst )

4h00-4h15 pm

Coffee break

4h15-5h45 pm

Examples of the diversity of research using multimodal data (emotional interaction and communication, emotional experience) (Jean-Claude Martin, Federica Cavicchio, Marcello Mortillaro)

5h45-6h30 pm

Tension in music: cognition, emotion, brain, movement

(Carol Krumhansl)

Sunday 24 September

9h00-10h45 am

Presentation of the Blueprint for emotional competent agent (Klaus Scherer and colleagues): Presentation on how theory of emotion and research on expression and neurophysiology can inform computational modelling

10h45-11h15 am

Coffee break

11h15 am -12h30 pm

Presentation of the Grid Study

(Etienne Roesch, Johnny Fontaine, Klaus Scherer)

12h30-2h30 pm

Lunch

Sunday 24 September

Afternoon: Young researchers session

2h30-2h50 pm

ERDA: An Empathic Rationale Dialog Agent

(Megalie Ochs)

2h50-3h10 pm

High level prosody related features: through the construction of a model for emotional speech

(Loic Kessous)

3h10-3h30 pm

Implications of embodiment from an emotional software agent perspective

 (Stefan Rank)

3h30-3h50 pm

Emotional body movements (Ahmad Shaarani)

3h50-4h10 am

Coffee break

4h10-4h30 pm

Affective multimedia interaction grounded on a cognitive science approach: interpreting indirect measures of emotion and modeling the affective relationship to multimedia content (Olivier Villon)

4h30-4h50 pm

Generation of facial emotional expressions based on Scherer psychological theory (Amandine Grizard)

4h50-5h10 pm

Avatar expressions with Scherer theory (Marco Paleari)

8h00 pm

Social dinner

Monday 25 September

Morning: Session on Relations between movement/gesture and emotion

9h00-9h30 am

Full-body motion analysis for animating expressive, socially attuned agents

 (Elisabetta Bevacqua, Ginevra Castellano)

9h30-10h00 am

Perception of movement expressivity in emotional TV interviews (Jean-Claude Martin)

10h00-10h30 am

The pianist body during performance. Differences in emotion management and perception (Isabella Poggi)

10h30-11h00 am

Coffee break

11h00-11h30 am

Gesture expressivity breaks in a conversational interaction (Nicolas Ech Chafai)

11h30-12h00 am

Gestures while reporting emotions (Giorgio Merola)

12h00-12h30 pm

A computational model for body expression of emotion in human-computer interaction

 (Marina Ousov-Fridin)

12h30-2h30 pm

Lunch

Afternoon: Session on Emotion in Social Cognition and Interaction

2h30-3h00 pm

Dynamic modeling of interpersonal stances towards an ECA based on linguistic and acoustic features

 (Nicole Novielli)

3h00-3h30 pm

Modifying affective bonds depending on the quality of interaction

(Arnaud Blanchard)

3h30-3h45 pm

Coffee break

3h45-4h15 pm

 Social context based emotion expression

 (Radoslaw Niewiadomski)

4h15-4h45 pm

Increasing the feeling of presence with affective modalities

  (Zerrin Kasap)

Tuesday 26 September

9h00-10h30 am

Workshop on Sequential Analysis for the study of emotion (I) (Rene te Boekhorst)

10h30-11h00 am

Coffee break

11h00-12h00 am

Workshop on Sequential Analysis for the study of emotion (I) (Rene te Boekhorst)

12h00-12h30 pm

Vital signs treatment and fusion in e-learning applications (Stefano Scotti)

12h30-1h00 pm

Linguistic approaches to human-robot emotional speech interaction

(Artemy Kotov)

1h00-2h30 pm

Lunch

2h30-3h30 pm

Towards Artificial Consciousness: the 'what problem'

(Vincenzo Tagliasco)

3h30-4h00 pm

ENACTIVE EU IST Project presentation

(Antonio Frisoli)

4h00-4h30 pm

S2S2-Sound to Sense, Sense to Sound- EU IST Project presentation

       (Nicola Bernardini)

4h30-4h45 pm

Coffee break

4h45-6h15

Workshop on Sequential Analysis for the study of emotion (II) (Rene te Boekhorst)

Wednesday 27 September

Morning: Tutorial on Human Full-Body Movement and Gesture Analysis

9h00-11h00 am

Human full-body movement and gesture analysis computational models and computer tools

(DIST, ICCS)

11h00-11h30 am

Coffee break

11h30-1h00 pm

Collection of multimodal data

(DIST, ICCS)

Afternoon: Tutorial on Multimodal Gesture Analysis

2h30-3h30 pm

Designing an integral music controller: introducing bio-sensing and emotional state estimation as a component of gestural control of sound synthesis

(Ben Knapp)

3h30-4h30 pm

Experiments with EyesWeb and BioMuse finalized to building the experimental setup for the concert Premio Paganini (I)

(DIST, Ben Knapp)

4h30-4h45 pm

Coffee break

4h45-6h00 pm

Experiments with EyesWeb and BioMuse finalized to building the experimental setup for the concert Premio Paganini (II)

(DIST, Ben Knapp)

Thursday 28 September

Building the experimental setup for the concert Premio Paganini

9h00-11h00 am

Presentation of the experimental setup for the Premio Paganini concert

Discussion and validation of the scenario, hypotheses, and procedure with Antonio Camurri, Ben Knapp, Carol Krumhansl

11h00-11h30 am

Coffee break

11h30-12h00 am

Conclusions: definition of the final specifications for the experiment

12h00-1h00 pm

Technical set up on stage; videocameras and microphones with EyesWeb, BioMuse (I)

1h00-2h30 pm

Lunch

2h30-3h30 pm

Technical set up on stage; videocameras and microphones with EyesWeb, BioMuse (II)

3h30-6h00 pm

Rehearsals and refinement of the setup

9h00 pm

Public Concert