Rehm, M., André, E., Rehm, M., & André, E. (2007). More than just a friendly phrase: multimodal aspects of polite behavior in agents. In Toyoaki Nishida (Ed.), Conversational Informatics. Wiley.
In order to build embodied conversational agents that are able to communicate with the user in a more natural manner, the consideration of social aspects of communication is inevitable. But how do we gain the necessary insights in these aspects of communication? Due to the specific needs of technical artifacts like embodied conversational agents, the literature does not always give us the specific information necessary to build a running system. To keep the intuition of the researcher at bay, the video-based analysis of human-human interaction becomes ever more popular to meet the specific information needs of the computer scientist. In this chapter, we examine the merits and the use of video-based corpus analysis using the example of multimodal politeness strategies. The use of politeness is a pervasive aspect of social interaction; however, the literature on politeness focuses mainly on verbal means. But an embodied conversation agent is inherently multi-modal, making it necessary to incorporate not only verbal politeness behaviors.