Personal tools
You are here: Home Members BjoernSchuller's Home

Home page for BjoernSchuller

Home page of Bjoern Schuller

Björn Schuller
Björn Schuller
Imperial College London
Key research interests:

Provision of tools to the community, as the open Emotion and Affect Recognition Toolkit ("openEAR"), Multimodal Recognition of Emotion, foremostly by speech and text analysis, Affect-robust Automatic Speech Recognition, Recognition of Non-linguistic Vocalisations as laughter, Mood in Music, novel machine learning architectures (e.g. Tandem BLSTM-DBN), novel feature types as by non-negative matrix factorization, standardization issues.
I received my diploma in 1999, my doctoral degree for my study on Automatic Speech and Emotion Recognition in 2006, and my habilitation (fakultas docendi) and was entitled Adjunct Teaching Professor (venia legendi) in the subject area of Signal Processing and Machine Intelligence for my work on Intelligent Audio Analysis in 2012 all in electrical engineering and information technology from TUM in Munich/Germany.

At present, I am Full Professor and head of the Chair of Complex and Intelligent Systems at the University of Passau/Germany where I previously headed the Chair of Sensor Systems in 2013. At the same time I am a Senior Lecturer (Associate Professor) in Machine Learning in the Department of Computing at Imperial College London/UK (since 2013). Further, I am the co-founding CEO of audEERING UG (limited) – a TUM start-up on intelligent audio engineering. Previously, I headed the Machine Intelligence and Signal Processing Group at TUM from 2006 to 2014. In 2013 I was also invited as a permanent Visiting Professor in the School of Computer Science and Technology at the Harbin Institute of Technology, Harbin/P.R. China and a Visiting Professor at the Université de Genève in Geneva/Switzerland in the Centre Interfacultaire en Sciences Affectives and remain an appointed associate of the institute. In 2012 I was with Joanneum Research, Institute for Information and Communication Technologies in Graz/Austria - currently I am an expert consultant of the institute. In 2011 I was guest lecturer at the Università Politecnica delle Marche (UNIVPM) in Ancona/Italy and visiting researcher in the Machine Learning Research Group of NICTA in Sydney/Australia. From 2009 to 2010 I lived in Paris/France and was with the CNRS-LIMSI Spoken Language Processing Group in Orsay/France, and was a visiting scientist at Imperial College.

Since 2000 I am working in the field of Emotion Recognition, since 2007 I am elected member of the HUMAINE Association Executive Committee, and since 2012 and 2013 president-elect and president of the Association. Currently, I am also running the Special Interest Group on Emotion Recognition from Speech (SIG-Speech), am the Editor in Chief in the 2015-2017 term of our Transactions on Affective Computing, and associate and repeated guest editor for the Computer Speech and Language, associate editor for the IEEE Transactions on Cybernetics, the IEEE Signal Processing Letters, and the IEEE Transactions on Neural Networks and Learning Systems, and guest editor for the IEEE Intelligent Systems Magazine, Speech Communication, Image and Vision Computing, Cognitive Computation, and the EURASIP Journal on Advances in Signal Processing, and workshop and challenge organizer including the first of their kind INTERSPEECH 2009-2015 Computational Paralinguistics Challenges and the 2011-2014 Audio/Visual Emotion Challenge and Workshop and programme committee member of many international workshops and conferences.

I am also coordinator of the European Community funded ASC-Inclusion project that aims to help children with autism spectrum condition to improve their socio-emotional skills by digital serious gaming and holder of an ERC Starting Grant in the broader field of Affective Computing ("iHEARu") besides currently participant in three H2020 projects (ARIA-VALUSPA, MixedEmotions, and SEWA). My research team was further part of the awarded SEMAINE project, and I steered projects dealing with Affective Computing funded by the German Research Foundation (DFG) and companies such as BMW, Continental, Daimler, Siemens, Toyota, and VDO. Advisory board activities further comprise my membership as invited expert in the W3C Emotion Incubator and Emotion Markup Language Incubator Groups.

Current topics of my research interests are:

  • Provision of tools to the community, as the open Emotion and Affect Recognition Toolkit ("openEAR").
  • Multimodal Recognition of Emotion, foremostly by speech and text analysis
  • Affect-robust Automatic Speech Recognition
  • Recognition of non-linguistic vocalisations as laughter
  • Mood in Music and Sound
  • Novel machine learning architectures (e.g., Deep BLSTM Neural Networks, Tandem BLSTM-DBN, Deep Semi-NMF, etc.).


Please feel free to contact me via schuller at tum.de or schuller at IEEE.org or find more details about my more than 400 publications, and reviewing, program committee, and general membership activities here.

Some Selected Recent Publications:

  • Björn Schuller, Anton Batliner: "Computational Paralinguistics: Emotion, Affect and Personality in Speech and Language Processing", Wiley, 2013.
  • Björn Schuller: "The Computational Paralinguistics Challenge", IEEE Signal Processing Magazine, IEEE, Vol. 29, Issue 4, 5 pages, July 2012.
  • Björn Schuller: "Recognizing Affect from Linguistic Information in 3D Continuous Space", IEEE Transactions on Affective Computing, IEEE, 15 pages, 2012.
  • Björn Schuller, Anton Batliner, Stefan Steidl, Dino Seppi: "Recognising Realistic Emotions and Affect in Speech: State of the Art and Lessons Learnt from the First Challenge", Speech Communication, ELSEVIER, Vol. 53, No. 9/10, pp. 1062-1087, November/December 2011.
  • Björn Schuller, Bogdan Vlasenko, Florian Eyben, Martin Wöllmer, André Stuhlsatz, Andreas Wendemuth, Gerhard Rigoll: "Cross-Corpus Acoustic Emotion Recognition: Variances and Strategies", IEEE Transactions on Affective Computing, IEEE, Vol. 1, No. 2, pp. 119-131, July-December 2010.
  • Björn Schuller, Clemens Hage, Dagmar Schuller, Gerhard Rigoll: "'Mister D.J., Cheer Me Up!': Musical and Textual Features for Automatic Mood Classification", Journal of New Music Research, Routledge Taylor & Francis Group, Vol. 39, No. 1, pp. 13-34, 2010.
  • Björn Schuller, Ronald Müller, Florian Eyben, Jürgen Gast, Benedikt Hörnler, Martin Wöllmer, Gerhard Rigoll, Anja Höthker, Hitoshi Konosu: "Being Bored? Recognising Natural Interest by Extensive Audiovisual Integration for Real-Life Application", Image and Vision Computing, ELSEVIER, Vol. 27, Issue 12, pp. 1760-1774, November 2009.
  • Angeliki Metallinou, Martin Wöllmer, Athanasios Katsamanis, Florian Eyben, Björn Schuller, Shrikanth Narayanan: "Context-Sensitive Learning for Enhanced Audiovisual Emotion Classification", IEEE Transactions on Affective Computing, IEEE, 14 pages, 2011.
  • Martin Wöllmer, Björn Schuller, Florian Eyben, Gerhard Rigoll: "Combining Long Short-Term Memory and Dynamic Bayesian Networks for Incremental Emotion-Sensitive Artificial Listening", IEEE Journal of Selected Topics in Signal Processing, IEEE, vol. 4, no. 5, pp. 867-881, October 2010.
  • Anton Batliner, Stefan Steidl, Björn Schuller, Dino Seppi, Thurid Vogt, Johannes Wagner, Laurence Devillers, Laurence Vidrascu, Vered Aharonson, Loic Kessous, Noam Amir: "Whodunnit - Searching for the Most Important Feature Types Signalling Emotion-Related User States in Speech", Computer Speech and Language, ELSEVIER, vol. 25, issue 1, pp. 4-28, 2011.
  • Florian Eyben, Martin Wöllmer, Alex Graves, Björn Schuller, Ellen Douglas-Cowie, Roddy Cowie: "On-line Emotion Recognition in a 3-D Activation-Valence-Time Continuum using Acoustic and Linguistic Cues", Journal on Multimodal User Interfaces, Springer, Berlin/Heidelberg, ISSN 1783-7677, vol. 3, no. 1-2, pp. 7-12, March 2010.
  • Marc Schröder, Elisabetta Bevacqua, Roddy Cowie, Florian Eyben, Hatice Gunes, Dirk Heylen, Mark ter Maat, Gary McKeown, Sathish Pammi, Maja Pantic, Catherine Pelachaud, Björn Schuller, Etienne de Sevin, Michel Valstar, Martin Wöllmer : "Building Autonomous Sensitive Artificial Listeners", IEEE Transactions on Affective Computing, IEEE, 20 pages, 2012.
Document Actions
Powered by Plone

Portal usage statistics