Gesticon Multimodal Behaviour Description Meeting 2006
This meeting is devoted to the discussion of representation formats for specifying multimodal behaviour in embodied conversational agents (ECAs). Researchers within HUMAINE have been working on the development of a representation language for building repositories of multimodal behaviour, so called Gesticons. This has been complemented by work on SAIBA, a common architecture for embodied agents, initiated by researchers outside HUMAINE. The meeting in Vienna is to both deepen and consolidate the cooperation in this community. At the same time, it offers an opportunity to build a new platform for discussing the topic of behaviour representations by presenting it to a broader circle of experts from both within and outside HUMAINE.
Vienna, November 6-8, 2006
This meeting takes place in the context of the WP10 Workshop on Good Practice and Standards of the EU-IST Network of Excellence HUMAINE.
The workshop has been organised jointly by HUMAINE, the EU funded project RASCALLI, the project CRC 673 "Alignment in Communication" of the German Research Foundation and by Reykjavik University.
Motivation and Goals
This meeting is devoted to the discussion of representation formats for specifying multimodal behaviour in embodied conversational agents (ECA). The current lack of common representation formats and interfaces heavily impedes the development of modules that can be interchanged between systems. This has been identified as a major obstacle within the ECA community for quite some time.
Against this background, researchers within HUMAINE have been working on the development of a representation language for building repositories of multimodal behaviour, so called Gesticons. This has been complemented by work on SAIBA, a common architecture for embodied agents, which was initiated by researchers outside the HUMAINE Network-of-Excellence. A close cooperation between the researchers working on these topics has been established at a Workshop in Reykjavik, 2005. (Cf. Related Workshops, below)
The purpose of the meeting in Vienna is to both deepen and consolidate the existing cooperation between researchers that have been working on the development of the Gesticon and on SAIBA before. At the same time the meeting offers an opportunity to build a new platform for discussing the topic of behaviour representations by presenting it to a broader circle of experts from both within and outside HUMAINE.
Format of the Meeting
The meeting is centred around the discussion of necessary changes and extensions to the current Gesticon, the Behaviour Markup Language (BML) and the Functional Markup Language (FML), which are the representation formats proposed for SAIBA.
The meeting begins with presentations on the current state of Gesticon and SAIBA but then will move to open discussions on future developments. In order allow for an efficient work a certain acquaintance with the basic ideas of the representation formats to be discussed is expected. (Cf. Meeting Materials, below).
Programme
Tuesday, November 7
- 09:30 - 10:00 Goals of the Gesticon Behaviour Description Meeting (Catherine Pelachaud)
- 10:00 - 10:30: Basic ideas behind SAIBA/BML (recap of IVA presenation) (Stefan Kopp)
- 10:30 - 11:00: Recap of open topics coming up in previous email-discussions (Hannes Högni Vilhjalmsson)
- 11:00 - 11:30: Coffee break
- 11:30 - 12:00: The Gesticon: What it was, what it is and what it should be (Hannes Pirker)
- 12:00 - 12:45: General discussion (model, architecture, etc)
- 12:45 - 14:00: Lunch
- 14:00 - 16:00: BML discussion (chair Hannes Högni Vilhjalmsson)
- synchronization
- levels and ways of behavior specifications
- interplay with animation engines, how much is due to decisions of a specific animation engine?
- Compare experiences from SmartBody, Greta, ACE, Nebula, Twente, ...
- 16:00 - 16:30: Coffee break
- 16:30 - 18:00: Resusable behavior repositories like Gesticon (chair Stefan)
- pros and cons
- Gesticon: fundamental ideas behind it, what are the problems
- 18:00 - 18:30: Wrap-up & recap, suggestions for day 2
- 19:30 WP10 Workshop Social Dinner at a Viennese
'Heuriger'
Wednsday, November 8:
- 09:00 - 9:30 The W3C Emotion Incubator group (WP10 workshop joint session, Marc Schröder)
- 09:30 - 11:00: BML - pick up open issues, next steps (chair Hannes Pirker)
- 11:00 - 11:30: Coffee break
- 11:30 - 13:00: Towards FML (chair Catherine Pelachaud)
- what are the major parts/aspects of FML
- how flexible must FML be
- are there lessons to be learned from EARL (the emotion representation language) for designing FML
- 13:00 - 14:00: Cooperation and organisational issues (chair Brigitte Krenn)
- 14:00 - 16:00 Lunch ans transfer to OFAI
- 16:00 - 18:00: Continuation of meeting at OFAI
Alphabetic List of Participants
- Bída, Michal (Charles University, Prague)
- Chafai, Nicolas Ech (Universite Paris8)
- Kipp, Michael (DFKI, Germany)
- Kopp, Stefan (Univ. Bielefeld, Germany)
- Krenn, Brigitte (OFAI, Vienna)
- Kriegel, Michael (Heriot-Watt University, Edinburgh)
- Mancini, Maurizio (Universite Paris8)
- Martin, Jean-Claude (France Telecom)
- Paiva, Ana (INESC, Lisbon)
- Pelachaud, Catherine (Universite Paris8)
- Pirker, Hannes (OFAI, Vienna)
- Prechtl, Reinhard (RadonLabs, Berlin)
- Ruttkey, Zsofia (University Twente)
- Vala, Marco (INESC, Lisbon)
- Vilhjalmsson, Hannes (Reykjavik University, Island)
Organisers
- Kopp, Stefan (Univ. Bielefeld, Germany)
- Krenn, Brigitte (OFAI, Vienna)
- Pelachaud, Catherine (Universite Paris8)
- Pirker, Hannes (OFAI, Vienna)
- Vilhjalmsson, Hannes (Reykjavik University, Island)
- Petta, Paolo & Rank, Stefan, WP10 workshop local
organisers (OFAI, Vienna)
Meeting Materials
Participants are requested to have a read of the following material.
- Kopp
et al IVA paper
"Towards a Common Framework for Multimodal Generation: The Behavior Markup Language", in Proc. of IVA'06, Marina del Rey, 2006. - HUMAINE
Deliverable D6e on Representation Languages
This HUMAINE Deliverable documents the current state of the representation language for Behaviour Repositories/ Gesticon. - SAIBA-Project
pages on MINDMAKERS.ORG (http://mindmakers.org/projects/SAIBA)
SAIBA/BML/FML Discussion forums on MINDMAKERS.ORG (http://forum.mindmakers.org/index.php/board,21.0.html)
SAIBA-forum on mindmakers.org. This pages require registration, which is free and open to any interested party. The SAIBA-project pages host a WIKI and separate discussion forums for BML and FML.
Related Workshops
This meeting is the most recent in a series of meetings, that were closely related to the topic of discussing common representation formats for the description of ECA-behaviours:
- 2002: Embodied conversational agents - let's specify and evaluate them!: AAMAS-02 workshop, Bologna, Italy.
- 2003 Gesticons for Expressive Embodied Conversational Characters: joint project meeting of EU-IST (projects: NECA, MagCister, lifeplus) and BMBF (project: Virtual Human), OFAI, Vienna, Austria.
- 2005: Representations
for Multimodal Generation Workshop: Reykjavik University,
Island.
Where to go from here?
The organisers wish to thank all the participants for their contributions to the discussions!
- Here you can access the Workshop summary.
-
You, and all other researchers interested in the topics of the meeting, are invited to join the project platform hosted by mindmakers.org, which is to become the central information hub for all further collaborations.
Last Edited: H.Pirker, P.Petta, 13Dec2006; P.Petta, 04Dec2006


3rd International Audio/Visual Emotion Challenge and Workshop (AVEC 2013)
