Computational Linguistics & Phonetics Computational Linguistics & Phonetics Fachrichtung 4.7 Universität des Saarlandes

Generating instructions in virtual environments

Softwareprojekt: Computerlinguistik, B.Sc./M.Sc.

Leitung: Alexander Koller
Ort: Geb. C 72, Seminarraum
Zeit: Do 10-12
Beginn: wird noch bekannt gegeben
Geeignet für: B.Sc./M.Sc.

The generation of natural-language instructions that help a user perform some task in a virtual environment is a hip new task in the field of natural language generation (NLG). This is primarily due to the Challenge for Generating Instructions in Virtual Environments (GIVE). In this challenge, the NLG system has access to complete symbolic information about the world, and can react to the user's actions in the world in real time. The challenge is interesting because it offers a new answer to the old problem of evaluating NLG systems, namely by connecting NLG systems to human experimental subjects over the Internet; in GIVE-1, we collected data from almost 1200 such subjects. It is also interesting because it moves the focus in NLG away from the generation of pure text, towards the much more realistic and challenging setting of generation in the context of a spatial environment, of real-time responses to events, and of an overarching task that has to be solved.

In this software project, the students will form up in teams and then design and develop NLG systems that we will then submit to the GIVE-2 Challenge, which has just started. Thus, this seminar offers you the chance to come up with creative ideas for instruction generation, implement them in a practical system that will be used by several hundred people over the Internet, and compete with other research teams around the world: So far, ten teams from seven countries have signed up. We will start the course with an overview of NLG and of previous approaches to GIVE, and talk about programming in teams. Then it will be up to you (with my help) to build a GIVE system.

Please see the course website for further details.

Zur Homepage des Kurses

Stellung im Studienplan
Wahlpflicht für B.Sc. Computerlinguistik; Regelstudienzeit 5. Semester; Area: CL

12 CP for B.Sc. Coli; 8 CP for M.Sc. LS&T