Computational Linguistics & Phonetics Computational Linguistics & Phonetics Fachrichtung 4.7 Universität des Saarlandes
Home

People

Jobs

Publications

Teaching

Short CV

Links


Publications


In preparation / Under review

  • Nikolina Mitev, Patrick Renner, Thies Pfeiffer and Maria Staudte
    "Towards efficient human-machine collaboration in real world: Effects of gaze-driven feedback and engagement on performance" (in rev)

  • Mirjana Sekicki and Maria Staudte
    "Eye'll help you out! How the gaze cue reduces the cognitive load required for reference processing" (under review)

  • Francesca Delogu, Torsten Jachmann, Maria Staudte, Francesco Vespignani and Nicola Molinaro
    "Not addressing a Question Under Discussion is costly: Evidence from ERPs" (in prep)

  • Christine Ankener, Mirjana Sekicki and Maria Staudte
    "The influence of visual uncertainty on word predictability and processing effort" (under review)

    •

Journal articles and Book chapters

  • Laura Fraedrich, Fabrizio Nunnari, Maria Staudte and Alexis Heloir
    "(Simulated) listener gaze in real-time spoken interaction". Computer Animation and Virtual Worlds (Special Issue CASA'18), 29(3-4):e1831-e1841, 2018.

  • Maria Staudte and Matthew W. Crocker
    "On the role of gaze for successful and efficient communication". To appear in: Geert Brone and Bert Oben (eds), Eyetracking in Interaction. Benjamins Publishing.

  • Maria Staudte and Gerry T.M. Altmann
    "Recalling what was where when seeing nothing there". Psychonomic Bulletin and Review, 24(2):400-407, 2017. [link]

  • Konstantina Garoufi, Maria Staudte, Alexander Koller and Matthew W. Crocker
    "Exploiting listener gaze to improve situated communication in dynamic virtual environments". Cognitive Science, 40(7):1671-1703, 2016.

  • Maria Staudte, Matthew W. Crocker, Alexis Heloir and Michael Kipp
    "The influence of speaker gaze on listener comprehension: Contrasting visual versus intentional accounts", Cognition, 133(1):317-328, 2014. [pdf]

  • Maria Staudte and Matthew W. Crocker
    "Investigating Joint Attention Mechanisms through Spoken Human-Robot Interaction", Cognition, 120:268-291, 2011. [pdf]


Peer-reviewed Conference Papers

  • Nikolina Mitev, Patrick Renner, Thies Pfeiffer and Maria Staudte
    "Using Listener Gaze to Refer in Installments Benefits Understanding"
    To appear in: Proceedings of the 40th Annual Conference of the Cognitive Science Society (CogSci), Madison WI, July 2018.

  • Christine Ankener, Heiner Drenhaus, Matthew W. Crocker and Maria Staudte
    "Multimodal Surprisal in the N400 and the Index of Cognitive Activity"
    To appear in: Proceedings of the 40th Annual Conference of the Cognitive Science Society (CogSci), Madison WI, July 2018.

  • Laura Fraedrich, Fabrizio Nunnari, Maria Staudte and Alexis Heloir
    "Simulating Listener Gaze and Evaluating Its Effect on Human Speakers"
    In: Beskow J., Peters C., Castellano G., O'Sullivan C., Leite I., Kopp S. (eds) Intelligent Virtual Agents (IVA 2017), Stockholm. LNCS, vol 10498, p.156-159, Springer.

  • Mirjana Sekicki and Maria Staudte
    "The Facilitatory Effect of Referent Gaze on Cognitive Load in Language Processing"
    In: Proceedings of the 39th Annual Conference of the Cognitive Science Society (CogSci), London, July 2017.

  • Torsten Jachmann, Heiner Drenhaus, Maria Staudte and Matthew Crocker
    "The Influence of Speaker's Gaze on Sentence Comprehension: An ERP Investigation"
    In: Proceedings of the 39th Annual Conference of the Cognitive Science Society (CogSci), London, July 2017.

  • Nikolina Mitev, Martin Villalba, Maria Staudte and Alexander Koller
    "The Impact of Listener Gaze on Predicting Reference Resolution"
    In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics (ACL) and the 7th IJCNLP (Short Papers), Beijing, July 2015. [pdf]

  • Nikolina Mitev, Sabrina Hoppe, Mehdi Moniri, Maria Staudte and Andreas Bulling
    "On the interplay between spontaneous spoken instructions and human visual behaviour in an indoor guidance task"
    In: Proceedings of the 37th Annual Conference of the Cognitive Science Society, Pasadena, July 2015. [pdf]

  • Chiara Gambi, Torsten Jachmann and Maria Staudte
    "Listen, look, go! The role of prosody and gaze in turn-end anticipation"
    In: Proceedings of the 37th Annual Conference of the Cognitive Science Society, Pasadena, July 2015. [pdf]

  • Alexander Koller, Konstantina Garoufi, Maria Staudte and Matthew W. Crocker
    "Enhancing referential success by tracking hearer gaze"
    In: Proceedings of the 13th Annual SIGdial Meeting on Discourse and Dialogue, Seoul, July 2012. [pdf] (Best Paper)

  • Maria Staudte, Alexander Koller, Konstantina Garoufi and Matthew Crocker
    "Using listener gaze to augment speech generation in a virtual 3D environment"
    In: Proceedings of the 34th Annual Conference of the Cognitive Science Society, Sapporo, August 2012. [pdf]

  • Maria Staudte, Matthew W. Crocker, Alexis Heloir and Michael Kipp
    "Speaker gaze affects utterance comprehension beyond visual attention shifts"
    In: Proceedings of the 33rd Annual Conference of the Cognitive Science Society, Boston, July 2011.

  • Maria Staudte, Alexis Heloir, Matthew W. Crocker and Michael Kipp
    "On the importance of gaze and speech alignment for efficient communication"
    In: Proceedings of the 9th International Gesture Workshop, Athens, May 2011. [pdf]

  • Maria Staudte and Matthew W. Crocker
    "When Robot Gaze Helps Human Listeners: Attentional versus Intentional Account"
    In: Proceedings of the 32nd Annual Conference of the Cognitive Science Society, Portland, August 2010. [pdf]

  • Maria Staudte and Matthew W. Crocker
    "Producing and resolving multi-modal referring expressions in human-robot interaction"
    In: Proceedings of "PRE-CogSci", Workshop at 31st Annual Conference of the Cognitive Science Society, Amsterdam, 29 July 2009. [pdf]

  • Maria Staudte and Matthew W. Crocker
    "The effect of robot gaze on processing robot utterances"
    In: Proceedings of the 31st Annual Conference of the Cognitive Science Society, Amsterdam, July 2009. [pdf]

  • Maria Staudte and Matthew W. Crocker
    "Visual Attention in Spoken Human-Robot Interaction"
    In: Proceedings of the 4th ACM/IEEE conference on Human-Robot Interaction, San Diego, March 2009. [pdf] (Nominated for best paper)

  • Maria Staudte and Matthew W. Crocker
    "The utility of gaze in spoken human-robot interaction"
    In: Proceedings of "Metrics for Human-Robot Interaction", Workshop at ACM/IEEE HRI 2008, Amsterdam, 12 March 2008. [pdf]


Conference Presentations

  • Laura Fraedrich, Fabrizio Nunnari, Maria Staudte and Alexis Heloir
    "(Simulated) listener gaze in real-time spoken interaction". Talk presented at the 31st International Conference on Computer Animation and Social Agents (CASA 2018), May 2018, Bejing.

  • Ankener, C. and Staudte, M.
    "Visually informed prediction: How combining lexical and visual information affects surprisal". Poster presented at the 31st Annual Conference on Sentence Processing (CUNY), March 2018, UC Davis.

  • Ankener, C. and Staudte, M.
    "The effect of multimodal predictability on the N400". Poster presented at the 9th Annual Meeting of the Society for the Neurobiology of Language (SNL), November 2017, Baltimore.

  • Fraedrich, L. and Staudte, M.
    "Simulating listener gaze and evaluating its effect on human speakers". Talk presented at the 23rd Annual Conference on Architectures and Mechanisms for Language Processing (AMLaP), September 2017, Lancaster.

  • Sekicki, M. and Staudte, M.
    "Language Processing in the VWP: The Cost of Gaze inspired Prediction". Poster presented at the 23rd Annual Conference on Architectures and Mechanisms for Language Processing (AMLaP), September 2017, Lancaster.

  • Jachmann, T., Drenhaus, H., Staudte, M. and Crocker, M.
    "Congruency effects of speaker's gaze on listeners' sentence comprehension". Poster presented at the 30th Annual Conference on Sentence Processing (CUNY), April 2017, MIT, Boston.

  • Ankener, C., Sekicki, M., and Staudte, M.
    "Visually informed prediction: How combining lexical and visual information affects surprisal". Poster presented at the 30th Annual Conference on Sentence Processing (CUNY), April 2017, MIT, Boston.

  • Sekicki, M. and Staudte, M.
    "Cognitive load in the visual world: The facilitatory effect of gaze". Poster presented at the 30th Annual Conference on Sentence Processing (CUNY), April 2017, MIT, Boston.

  • Sekicki, M., Ankener, C., and Staudte, M.
    "Cost and Gains of Using Visual Context for Referent Prediction". Talk presented at 9th Workshop on Embodied and Situated Language Processing (ESLP), October 2016, Chile.

  • Sekicki, M., Ankener, C., and Staudte, M.
    "Language Processing: Cognitive Load with(out) Visual Context". Poster presented at the 22nd Annual Conference on Architectures and Mechanisms for Language Processing (AMLaP), September 2016, Bilbao.

  • Ankener, C., Sekicki, M., and Staudte, M.
    "The influence of visual context on predictions in sentence processing: Evidence from ICA". Poster presented at the Language and Perception International Conference, June 2016, Trondheim.

  • Ankener, C., Sekicki, M., and Staudte, M.
    "Low predictability: A comparison of paradigms used for sentence comprehension". Poster presented at the 29th Annual Conference on Sentence Processing (CUNY), March 2016, Florida.

  • Macdonald, R. G., and Staudte, M.
    "The effect of a gazer's intentions on gaze seeking and following". Talk presented at the 3rd AttLis Workshop, March 2016, Potsdam.

  • Koleva, N., and Staudte, M.
    "Spontaneous spoken instructions and listener’s gaze availability in a dynamic real-world environment". Poster presented at the 3rd AttLis Workshop, March 2016, Potsdam.

  • Macdonald, R. G., and Staudte, M.
    "The effect of a gazer's intentions on gaze seeking and following". Poster presented at the 21st Annual Conference on Architectures and Mechanisms for Language Processing (AMLaP), September 2015, Malta.

  • Macdonald, R. G., and Staudte, M.
    "The role of intention in gaze following". Poster presented at the 18th European Conference on Eye Movements (ECEM), August 2015, Vienna.

  • Macdonald, R. G., and Staudte, M.
    "Is a listener's gaze following behaviour influenced by the intentions of a speaker?" Talk presented at Embodied and Situated Language Processing (ESLP), July 2015, Lyon.

  • Delogu, F. and Staudte, M.
    "Intensional expressions ask for details". Poster presented at the 19th Annual Conference on Architectures and Mechanisms for Language Processing (AMLaP), September 2013, Marseille.

  • Staudte, M., Koller, A., Garoufi, K., and Crocker, M.
    "Grounding spoken instructions using listener gaze in dynamic virtual environments". Abstract presented at the 5th Workshop on Embodied and Situated Language Processing (ESLP), August 2012, Newcastle.

  • Drenhaus, H., Staudte, M., and Crocker, M.
    "When gaze makes a difference: A comparative ERP study of gaze and arrow cues during sentence comprehension". Abstract presented at the 17th Annual Conference on Architectures and Mechanisms for Language Processing (AMLaP), September 2011, Paris.

  • Drenhaus, H., Staudte, M., and Crocker, M.
    "The influence of referential gaze on scene-sentence integration: An ERP-study". Abstract presented at the 4th Workshop on Embodied and Situated Language Processing (ESLP), August 2011, Bielefeld.

  • Staudte, M., Crocker, M., Heloir, A. and Kipp, M.
    "Speaker gaze affects sentence processing beyond visual attention shifts". Abstract presented at the 24th Annual Conference on Human Sentence Processing (CUNY), March 2011, Stanford.

  • Staudte, M. and Crocker, M.
    "The Dynamics of Referential Speaker Gaze: Order is important, Synchronization not so much". Extended abstract presented at the NIPS workshop on Human Communication Dynamics, December 2010, Whistler.

  • Jacobsson, H., Kruijff, G-J., Staudte, M.
    "Language Acquisition from Neural and Sensorimotor Systems". Extended abstract presented at the PASCAL workshop on Machine Learning and Cognitive Science of Language Acquisition, June 2007, London. [poster(pdf)] [pdf]

  • Jacobsson, H., Kruijff, G-J., Staudte, M.
    "From Rule Extraction to Active Learning Symbol Grounding". Extended abstract presented at the Concept Learning for Embodied Agents workshop at ICRA 2007, Rome. [pdf]



Talks