Computational Linguistics & Phonetics Computational Linguistics & Phonetics Fachrichtung 4.7 Universität des Saarlandes
Mulitmodal Interaction with Intelligent Agents
Multimodal Interaction with Intelligent Agents

Lecturers:Matthew Crocker, Maria Staudte

Seminar: Thursdays 12-14 (ct)
Geb. C7 1, U.15

Credits:7 CP (presentation and paper) or
4 CP (presentation only)

Course Contents

This seminar examines the coordination of linguistic (speech) and non-linguistic (gaze, gesture) information in multi-modal interaction. At a theoretical level, we investigate how non-linguistic behaviour influences linguistic message production and comprehension. Specifically, we consider evidence from both human-human studies and studies examining communication patterns in human-agent interaction (involving virtual agents as well as robots) in order to illuminate how information from different modalities is integrated. The issues discussed in this seminar include, for instance:
- what non-linguistic cues may reflect (from an individual's/agent's focus of attention to its mental and emotional states),
- how the appearance of an individual/agent influences the interpretation of its non-verbal behaviour (role of embodiment),
- whether the use of certain modalities evokes, or at least, reveals something about the theory of mind one interaction partner has about the other,
- what happens when linguistic and non-linguistic cues conflict.

+++ Note: +++
The list of topics (and associated readings) is available under "Topics" in the menu and the schedule can be found under "Schedule".