I had the chance to give a course on multimodality at the University of Fribourg (Switzerland) in the framework of the Certificate of Advanced Studies in Interaction Science and Technology:

http://human-ist.unifr.ch/cas/courses/social-signal-and-multimodal-processing

It has been an intensive day during which i have been teaching for six hours to a highly interactive class that has posed a large number of interesting questions. After introducing the concept of multimodality in disciplines like psychology and biology, I have shown how Artificial Intelligence deals with the phenomenon. In particular, I have shown how early and late fusion (the two basic methodologies for the development of multimodal approaches) can be thought of as modifications of Bayes Decision Theory. To complete the day, I have show how such methodologies have been applied in two interesting problems, namely the analysis of attachment in children and the inference of personality traits from simple vocalisations like “ehm” or “uhm”.