Personal tools
You are here: Home SIGs and LIGs Speech SIG Emotion Sentiment & Social Signals - ES³ 2012

Emotion Sentiment & Social Signals - ES³ 2012

ES³ 2012 4th International Workshop on Corpora for Research on EMOTION SENTIMENT & SOCIAL SIGNALS Satellite of LREC 2012, ELRA, Full Day Workshop on 26 May, Istanbul, Turkey

Call for Papers

Abstract Submission



Laurence Devillers

U. Paris-Sorbonne 4, France


Björn Schuller

TUM, Germany


Anton Batliner

FAU, Germany


Paolo Rosso

U. Politec. Valencia, Spain


Ellen Douglas-Cowie Queen's Univ. Belfast, UK


Roddy Cowie

Queen's Univ. Belfast, UK


Catherine Pelachaud

CNRS - LTCI, France







The fourth instalment of the workshop series on Corpora for Research on Emotion held at LREC aims at further cross-fertilisation between the highly related communities of emotion and affect processing based on acoustics of the speech signal, and linguistic analysis of spoken and written text, i.e., the field of sentiment analysis including figurative languages such as irony, sarcasm, satire, metaphor, parody, etc. At the same time, the workshop opens up for the emerging field of behavioural and social signal processing including signals such as laughs, smiles, sighs, hesitations, consents, etc. Besides data from human-system interaction, dyadic and human-to-human data, its labelling and suited models as well as benchmark analysis and evaluation results on suited and relevant corpora are invited. By this, we aim at bridging between these larger and highly connected fields: Emotion and sentiment are part of social communication, and social signals are highly relevant in helping to better understand affective behaviour and its context. For example, understanding of a subject's personality is needed to make better sense of observed emotional patterns. At the same time, non-linguistic behaviour such as laughter and linguistic analysis can give further insight into the state or personality trait of the subject.


All these fields further share a unique trait: Genuine emotion, sentiment and social signals are hard to collect, ambiguous to annotate, and tricky to distribute due to privacy reasons. In addition, the few available corpora suffer from a number of issues owing to the peculiarity of these young and emerging fields: As in no related task, different forms of modelling exist, and ground truth is never solid due to the often highly different perception of the mostly very few annotators. Due to data sparseness, cross-validation without strict partitioning including development sets and without strict separation of speakers and subjects throughout partitioning are frequently seen.

Program Committee


Vered Aharonson, AFEKA, Israel
Alexandra Balahur, EC JRCentre, Italy
Felix Burkhardt, D. Telekom, Germany
Carlos Busso, UT Dallas, USA
Rafael Calvo, U. Sydney, Australia
Erik Cambria, NUS, Singapore
Antonio Camurri, U. Genova, Italy
Mohamed Chetouani, UPMC, France
Thierry Dutoit, Univ. Mons, Belgium
Julien Epps, UNSW, Australia
Anna Esposito, IIASS, Italy
Hatice Gunes, Queen Mary Univ., UK
Catherine Havasi, MIT Media Lab., USA
Bing Liu, U. Illinois Chicago, USA
Florian Metze, CMU, USA
Shrikanth Narayanan, USC, USA
Maja Pantic, Imperial College, UK
Antonio Reyes, UP Valencia, Spain
Fabien Ringeval, U. Fribourg, CH
Peter Robinson, U. Cambridge, UK
Florian Schiel, LMU, Germany
Jianhua Tao, CAS, China
Jose A. Troyano, U. de Sevilla, Spain
Tony Veale, UCD, Ireland
Alessandro Vinciarelli, U. Glasgow, UK
Haixun Wang, Microsoft, China


Important Dates


1500-2000 words abstract submission deadline

1 March 2012 (extended)


Notification of acceptance

20 March 2012 (shifted due to submission extension)


Camera ready paper

30 March 2012 (extended)



26 May 2012



Topics include, but are not limited to:


+ Novel corpora of affective speech in audio & multimodal data

+ Novel corpora for sentiment and opinion mining analysis

+ Novel corpora of audio & multimodal social signals

+ Novel corpora with combined annotation of the above

+ Analysis in speech, language and multimodal cues

+ Rich emotion and personality: dimensional, categories, etc.

+ Figurative languages: irony, sarcasm, satire, metaphor, parody

+ Social signals: laughs, smiles, sighs, hesitations, consents, etc.

+ Discussion of models for emotion, sentiment & social signals

+ Measures for quantitative corpus quality assessment

+ Standardisation of corpora and labels for cross-corpus testing

+ Real-life applications of language & multimodal resources

+ Long-term recordings of interactional & dyadic communication

+ Rich and novel annotations such as situational context

+ Communications on testing protocols

+ Evaluations on novel or multiple corpora

+ New methods for community or distributed annotation

+ Unsupervised learning techniques to exploit additional data

+ Synthesis of data for learning in sparse data tasks

+ Resources for underrepresented languages & cultures

+ Evaluations on novel or multiple corpora


Submission Policy


Submitted abstracts of papers for oral and

poster must consist of about 1500-2000


Final submissions should be 4 to 8 pages long,

must be in English, and follow the submission guidelines at LREC 2012. Please follow this link for submission.


When submitting a paper from the START

page, authors will be asked to provide

essential information about resources (in a

broad sense, i.e. also technologies, standards, evaluation kits, etc.) that have been used for

the work described in the paper or are a new result of your research. For further information on this new initiative, please refer to



Workshop Programme

09:00 - 09:10
Laurence Devillers

(Chair: Paolo Rosso)

09:10 - 09:30
Andrea Gianti, Cristina Bosco, Viviana Patti, Andrea Bolioli and Luigi Di Caro
Annotating Irony in a Novel Italian Corpus for Sentiment Analysis

09:30 - 09:50
Sandi Pohorec, Ines Ceh, Peter Kokol and Milan Zorman
Sentiment Analysis Resources for Slovene Language

09:50 - 10:10
Ozan Cakmak, Abe Kazemzadeh, Dogan Can, Serdar Yildirim and Shrikanth Narayanan
Root-Word Analysis of Turkish Emotional Language

10:10 - 10:30
Minlie Huang, Lei Fang and Xiaoyan Zhu
A Chinese Corpus for Sentiment Analysis

10:30 - 11:00

(Chair: Catherine Pelachaud)

11:00 - 11:20
Khiet Truong and Jürgen Trouvain
Laughter Annotations in Conversational Speech Corpora – Possibilities and Limitations for Phonetic Analysis

11:20 - 11:40
Radoslaw Niewiadomski, Jérôme Urbain, Catherine Pelachaud and Thierry Dutoit
Finding out the Audio and Visual Features that Influence the Perception of Laughter Intensity and Differ in Inhalation and Exhalation Phases

11:40 - 12:00
Gary McKeown, Roddy Cowie, Will Curran, Willibald Ruch and Ellen Douglas-Cowie
ILHAIRE Laughter Database

12:00 - 12:20
Jürgen Trouvain and Khiet Truong
Comparing Non-Verbal Vocalisations in Conversational Speech Corpora

12:20 - 12:40
Magalie Ochs, Paul Brunet, Gary McKeown, Catherine Pelachaud and Roddy Cowie
Smiling Virtual Characters Corpora

12:40 - 13:00
Isabella Poggi, Francesca D'Errico and Laura Vincze
Ridiculization in Public Debates: Making Fun of the Other as a Discrediting Move

13:00 - 14:00

(Chair: Laurence Devillers)

14:00 - 14:20
Rene Altrov and Hille Pajupuu
Estonian Emotional Speech Corpus: Theoretical Base and Implementation

14:20 - 14:40
Dipankar Das, Soujanya Poria, Chandra Mohan Dasari and Sivaji Bandyopadhyay
Building Resources for Multilingual Affect Analysis - A Case Study on Hindi, Bengali and Telugu

14:40 - 15:00
Clément Chastagnol and Laurence Devillers
Collecting Spontaneous Emotional Data for a Social Assistive Robot

15:00 - 15:20
Wenjing Han, Haifeng Li, Lin Ma, Xiaopeng Zhang and Björn Schuller
A Ranking-based Emotion Annotation Scheme and Real-life Speech Database

15:20 - 15:40
John Snel, Alexey Tarasov, Charlie Cullen and Sarah Jane Delany
A Crowdsourcing Approach to Labelling a Mood Induced Speech Corpora

15:40 - 16:00
Serkan Özkul, Elif Bozkurt, Shahriar Asta, Yücel Yemez and Engin Erzin
Multimodal Analysis of Upper-Body Gestures, Facial Expressions and Speech

16:00 - 16:30

(Chair: Haifeng Li)

16:30 - 16:50
Dietmar Rösner, Jörg Frommer, Rico Andrich, Rafael Friesen, Matthias Haase, Manuela Kunze, Julia Lange and Mirko Otto
LAST MINUTE: a Novel Corpus to Support Emotion, Sentiment and Social Signal Processing

16:50 - 17:10
Katia Lida Kermanidis
Mining Authors’ Personality Traits from Modern Greek Spontaneous Text

17:10 - 17:30
Antonio Reyes and Paolo Rosso
Building Corpora for Figurative Language Processing: The Case of Irony Detection

17:30 - 17:50
Marcela Charfuelan and Marc Schröder
Correlation Analysis of Sentiment Analysis Scores and Acoustic Features in Audiobook Narratives

17:50 - 18:10
Effie Mouka, Voula Giouli, Aggeliki Fotopoulou and Ioannis E. Saridakis
Opinion and Emotion in Movies: a Modular Perspective to Annotation

18:10 - 18:30
Paolo Rosso
Closing Discussion

19:00 - 21:00
Optional Common Dinner
Covered by participants

Last updated: 05 April 2012.
Document Actions
Powered by Plone

Portal usage statistics