Computational Linguistics & Phonetics Computational Linguistics & Phonetics Fachrichtung 4.7 Universität des Saarlandes

Chiara Gambi - Seminars

Chiara Gambi - Seminars


Sommersemester 2014

Turn-taking in dialogue: a psycholinguistic perspective.

How do people manage turn-taking (i.e., who speaks when) while having conversations? This question has been tackled in several disciplines (from sociology to lingusitics) and is relevant for the improvement of human-computer interaction through dialogue systems. Corpus studies have examined the distribution of pauses and overlaps between interlocutors' turns in a number of languages, and there has been some work examining features that co-occur with turn-ends. However, it is still largely unclear how interlocutors implement turn-taking: what kind of cognitive mechanisms are involved?; are the processes involved best described at the level of social and cultural conventions, or at the level of automatic alignment and convergence?; are the same processes involved in face-to-face as in telephone conversations? The semianr will provide an overview of the literature and argue that a psycholinguistic perspective on these issues is necessary. Turn-taking should be the subject of rigorous experimental studies, just as other dialogue phenomena (e.g. lexical alignment). Assessment will consist of a 45 minute-long presentation to be delivered in class. Participation in the discussion following other students' presentations will also form integral part of the evaluation.

Outline

23/04/14 C. Gambi: Overview - slides

30/04/14 C. Gambi: Multimodality - slides

07/05/14 C. Gambi: Prosody - slides; please email me if you would like to have a ppt version (with audio samples)

14/05/14 C. Gambi: Open issues - slides

Selected References

De Ruiter, J. P., Mitterer, H., & Enfield, N. J. (2006). Projecting the end of a speaker's turn: A cognitive cornerstone of conversation. Language, 82(3), 515-535. AND Magyari, L., & De Ruiter, J. P. (2012). Prediction of turn-ends based on anticipation of upcoming words. Frontiers in Psychology, 3. doi: 10.3389/fpsyg.2012.00376

Howes, C., Healey, P., Purver, M., & Eshghi, A. (2012). Finishing each other's ... Responding to incomplete contributions in dialogue. In N. Miyake, D. Peebles & R. P. Cooper (Eds.), Proceedings of the 34th Annual Conference of the Cognitive Science Society (pp. 479-484). Austin, TX: Cognitive Science Society. AND Howes, C., Purver, M., Healey, P. G. T., Mills, G. J., & Gregoromichelaki, E. (2011). On incrementality in dialogue: Evidence from compound contributions. Dialogue and Discourse, 2(1), 279-311.

Sacks, H., Schegloff, E. A., & Jefferson, G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50(4), 696-735.

Stivers, T., Enfield, N. J., Brown, P., Englert, C., Hayashi, M., Heinemann, T., . . . Levinson, S. C. (2009). Universals and cultural variation in turn-taking in conversation. Proceedings of the National Academy of Sciences, 106(26), 10587–10592.

Wilson, M., & Wilson, T. P. (2005). An oscillator model of the timing of turn-taking. Psychonomic Bulletin & Review, 12(6), 957-968.

Duncan, S. J. (1972). Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology, 23(2), 283-292.

Kendon, A. (1967). Some functions of gaze-direction in social interaction. Acta Psychologica, 26, 22-63.

Gravano, A., & Hirschberg, J. (2011). Turn-taking cues in task-oriented dialogue. Computer Speech and Language, 25(3), 601-634.

Hjalmarsson, A. (2011). The additive effect of turn-taking cues in human and synthetic voice. Speech Communication, 53(1), 23-35.

Bavelas, J. B., Coates, L., & Johnson, T. (2002). Listener responses as a collaborative process: The role of gaze. Journal of Communication, 52(3), 566-580.

Cassell, J., Torres, O., & Prevost, S. (1998). Turn taking vs. Discourse Structure: how best to model multimodal conversation. Wilks (ed.) Machine Conversations. Kluwer, The Hague.

Kurtic, E., Brown, G. J., & Wells, B. (2013). Resources for turn competition in overlapping talk. Speech Communication, 55(5), 721-743.

Barkhuysen, P., Krahmer, E., & Swerts, M. (2008). The interplay between the auditory and visual modality for end-of-utterance detection. The Journal of the Acoustical Society of America, 123(1), 354-365.

Edlund, J., & Beskow, J. (2009). Mushypeek: A framework for online investigation of audiovisual dialogue phenomena. Language and Speech, 52(2-3), 351-367.

Jonsdottir, G. R., Thorisson, K. R., & Nivel, E. (2008, January). Learning smooth, human-like turntaking in realtime dialogue. In Intelligent Virtual Agents (pp. 162-175). Springer Berlin Heidelberg.

Raux, A., & Eskenazi, M. (2009, May). A finite-state turn-taking model for spoken dialog systems. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics (pp. 629-637). Association for Computational Linguistics.

DeVault, D., Sagae, K., & Traum, D. (2009, September). Can I finish?: learning when to respond to incremental interpretation results in interactive dialogue. In Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue (pp. 11-20). Association for Computational Linguistics.