Multimodal Interaction with Intelligent Agents

Lecturers:	Matthew Crocker, Maria Staudte
Seminar:	Thursdays 12-14 (ct)
	Geb. C7 1, U.15
Credits:	7 CP (presentation and paper) or
	4 CP (presentation only)

Course Contents

This seminar examines the coordination of linguistic (speech) and non-linguistic (gaze, gesture) information in multi-modal interaction. At a theoretical level, we investigate how non-linguistic behaviour influences linguistic message production and comprehension. Specifically, we consider evidence from both human-human studies and studies examining communication patterns in human-agent interaction (involving virtual agents as well as robots) in order to illuminate how information from different modalities is integrated. The issues discussed in this seminar include, for instance:

- what non-linguistic cues may reflect (from an individual's/agent's focus of attention to its mental and emotional states),

- how the appearance of an individual/agent influences the interpretation of its non-verbal behaviour (role of embodiment),

- whether the use of certain modalities evokes, or at least, reveals something about the theory of mind one interaction partner has about the other,

- what happens when linguistic and non-linguistic cues conflict.

+++ Note: +++
The list of topics (and associated readings) is available under "Topics" in the menu and the schedule can be found under "Schedule".