Introduction to Corpus Resources, Annotation and Access

References

Tokenisation and Morpho-Syntactic Annotation

• Gregory Grefenstette and Pasi Tapanainen (1994): What is a word, what is a sentence? Problems of tokenization. In Proceedings of the 3rd Conference on Computational Lexicography and Text Research, pp. 79-87. Budapest, Hungary.
• Andrei Mikheev (2002): Periods, Capitalized Words, etc. Computational Linguistics, 28(3):289-318.
• Andrei Mikheev (2003): Text segmentation. In: Ruslan Mitkov, editor: The Oxford Handbook of Computational Linguistics, pp. 376-394. Oxford University Press.
• Helmut Schmid (2007?): Tokenizing. In: Anke Lüdeling and Merja Kytö, editors: Corpus Linguistics. An International Handbook. Mouton de Gruyter, Berlin.
• Tokeniser:
  • LT TTT versions 1.0 and 3.0 beta, Edinburgh Language Technology Group: text tokenization and toolset
  • MXTERMINATOR, Jeffrey C. Reynar and Adwait Ratnaparkhi (1997): A Maximum Entropy Approach to Identifying Sentence Boundaries. In Proceedings of the 5th Conference on Applied Natural Language Processing. Washington, D.C.

• Anne Schiller and Simone Teufel (1995): Guidelines für das Tagging deutscher Textkorpora mit STTS. Manuscript, in German. Institut für Maschinelle Sprachverarbeitung, Universität Stuttgart.
• Christopher D. Manning and Hinrich Schütze (1999): Foundations of Statistical Natural Language Processing, chapter 10. MIT Press.
• Atro Voutilainen (2003): Part-of-speech tagging. In: Ruslan Mitkov, editor: The Oxford Handbook of Computational Linguistics, pp. 219-232. Oxford University Press.
• Helmut Schmid (2007?): Part-of-Speech Tagging. In: Anke Lüdeling and Merja Kytö, editors: Corpus Linguistics. An International Handbook. Mouton de Gruyter, Berlin.
• Tagger:
  • TnT - Trigram Tagger, Thorsten Brants (2000): TnT - A statistical part-of-speech tagger. In Proceedings of the 6th Applied Natural Language Processing Conference.
  • Tree Tagger, Helmut Schmid (1994): Probabilistic part-of-speech tagging using decision trees. In Proceedings of the International Conference on New Methods in Language Processing.
  • Brill Tagger, Eric Brill (1995): Transformation-based error-driven learning and Natural Language Processing: A case study in part-of-speech tagging. Computational Linguistics, 21(4):543-565.

• Kimmo Koskenniemi (1984): A general computational model for word-form recognition and production. In Proceedings of the 10th International Conference on Computational Linguistics, pp. 178-181.
• Kenneth R. Beesley and Lauri Karttunen (2003): Finite state morphology. CSLI Publications.
• Harald Trost (2003): Computational Morphology. In: Ruslan Mitkov, editor: The Oxford Handbook of Computational Linguistics, pp. 25-47. Oxford University Press.
• Marco Baroni (2003): Distribution-driven morpheme discovery: A computational/experimental study. In: Geert Booij and Jaap van Marle, editors: "Yearbook of Morphology 2003", pp. 213-248.
• Harald Hammarström (2006): A naive theory of affixation and an algorithm for extraction. In Proceedings of the 8th Meeting of the ACL Special Interest Group in Computational Phonology (SIGPHON).
• PASCAL challenge on "Unsupervised segmentation of words into morphemes"
• Morphological analyser:
  • Porter Stemmer (for English)
  • Snowball, a system for stemming algorithms
  • Stuttgart Finite State Transducer Tools (SFST)

• Kenneth W. Church and Patrick Hanks (1990): Word association norms, mutual information, and lexicography. Computational Linguistics, 16(1):22-29.
• Ted Dunning (1993): Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61-74.
• Harald Baayen (2001): Word frequency distributions. Kluwer Academic Publishers.
• Stefan Evert (2004): The statistics of word cooccurrences: word pairs and collocations. PhD thesis, Institut für Maschinelle Sprachverarbeitung, Universität Stuttgart.
• Marco Baroni (2007?): Distributions in Text. In: Anke Lüdeling and Merja Kytö, editors: Corpus Linguistics. An International Handbook. Mouton de Gruyter, Berlin.
• Oliver Christ, Bruno M. Schulze, Anja Hofmann, Esther König (1999): The IMS corpus workbench: Corpus Query Processor. Technical report, Institut für Maschinelle Sprachverarbeitung, Universität Stuttgart.
• Adam Kilgarriff, Pavel Rychly, Pavel Smrz, and David Tugwell (2004): The Sketch Engine. In Proceedings of the 11th EURALEX International Congress. Lorient, France.
• Collocations and multiword expressions online:
  • collocations.de
  • CQP demo
  • sketch engine
  • multiword expressions project

• Christopher D. Manning and Hinrich Schütze (1999): Foundations of Statistical Natural Language Processing, Section 8.1. MIT Press.
• Jean Carletta (1996): Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics, 22(2):249-254.
• Brigitte Krenn, Stefan Evert, and Heike Zinsmeister (2004): Determining intercoder agreement for a collocation identification task. In Proceedings of KONVENS (Konferenz zur Verarbeitung natürlicher Sprache). Vienna, Austria.
• Barbara Di Eugenio and Michael Glass (2004): The kappa statistic: A second look. Computational Linguistics, 30(1):95-101.
• Application-based evaluation:
  • ParsEval
  • English parser evaluation test suite
  • SensEval
  • shared tasks at CoNNL
  • PASCAL challenges

Exercise: Tree Tagger

• Tree Tagger download
• Helmut Schmid (1994): Probabilistic part-of-speech tagging using Decision Trees. In Proceedings of the International Conference on New Methods in Language Processing.
• Helmut Schmid (1995): Improvements in part-of-speech tagging with an application to German. In Proceedings of the ACL SIGDAT Workshop.

Exercise: CQP

• IMS Corpus Workbench
• CQP download
• Oliver Christ (1994): A modular and flexible architecture for an integrated corpus query system. In Proceedings of the 3rd Conference on Computational Lexicography and Text Research. Budapest, Hungary.
• Oliver Christ, Bruno M. Schulze, Anja Hofmann, Esther König (1999): The IMS corpus workbench: Corpus Query Processor. Technical report (out of date), Institut für Maschinelle Sprachverarbeitung, Universität Stuttgart.
• Stefan Evert (2002): Corpus encoding tutorial: First steps. Draft, Institut für Maschinelle Sprachverarbeitung, Universität Stuttgart.
• Stefan Evert (2005): The CQP query language tutorial. Technical report, Institut für Maschinelle Sprachverarbeitung, Universität Stuttgart.

Semantic Annotation

• Michael Lesk (1986): Automatic sense disambiguation using machine readable dictionaries: How to tell a pine cone from an ice cream cone. In Proceedings of the SIGDOC Conference. Toronto, Canada.
• William A. Gale, Kenneth W. Church, and David Yarowsky (1992): One sense per discourse. In Proceedings of the DARPA Speech and Natural Language Workshop.
• Adam Kilgarriff (1997): I don't believe in word senses. Computers and the Humanities, 31(2):91-113.
• Patrick Hanks (2000): Do word meanings exist? Computers and the Humanities, 34(1-2):205-215.
• Martha Palmer (2000): Consistent criteria for sense distinctions. Computers and the Humanities, 34(1-2):217-222.

• George A. Miller, editor (1990): WordNet: An on-line lexical database. Special issue of the International Journal of Lexicography, 3(4). Pre-print version.
• Christiane Fellbaum, editor (1998): WordNet - An electronic lexical database. MIT Press.
• Piek Vossen (2004): EuroWordNet: A multilingual database of autonomous and language-specific WordNets connected via an interlingual index. International Journal of Lexicography, 17:161-173.
• WordNets online:
  • WordNet
  • EuroWordNet
  • MultiWordNet
  • Global WordNet Association

• Eva Hajicová, Jarmila Panevová, and Petr Sgall (2000): A manual for tectogrammatic tagging of the Prague Dependency Treebank. UFAL/CKL Technical Report TR-2000-09, Charles University, Prague.
• Alena Böhmová, Jan Hajic, Eva Hajicová, and Barbora Hladká (2003): The Prague Dependency Treebank: A three-level annotation scenario. In: Anne Abeille, editor: "Treebanks: building and using syntactically annotated corpora". Kluwer Academic Publishers.
• Petr Sgall, Jarmila Panevová, and Eva Hajicová (2004): Deep syntactic annotation: Tectogrammatical representation and beyond. In Proceedings of the HLT-NAACL Workshop on "Frontiers in Corpus Annotation". Boston, MA.
• Jan Hajic and Zdenka Uresová (2005): The Prague Dependency Treebank and Valency Annotation. Tutorial at RANLP, Borovets.
• PDT online

• Collin F. Baker, Charles J. Fillmore, and John B. Lowe (1998): The Berkeley FrameNet project. In Proceedings of the 17th International Conference on Computational Linguistics, pp. 86-90.
• Thierry Fontenelle, editor (2003): FrameNet and frame semantics. Special issue of the International Journal of Lexicography, 16(3).

• Katrin Erk, Andrea Kowalski, Sebastian Padó, and Manfred Pinkal (2003): Towards a resource for lexical semantics: A large German corpus with extensive semantic annotation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics.
• Aljoscha Burchardt, Katrin Erk, Anette Frank, Andrea Kowalski, Sebastian Padó, Manfred Pinkal (2006): The SALSA corpus: A German corpus resource for lexical semantics. In Proceedings of the 5th International Conference on Language Resources and Evaluation.

• Carlos Subirats and Hiroaki Sato (2004): Spanish FrameNet and FrameSQL. In Proceedings of the LREC Workshop on "Building Lexical Resources from Semantically Annotated Corpora".

• Kyoko Hirose Ohara, Seiko Fujii, Toshio Ohori, Ryoko Suzuki, Hiroaki Saito, and Shun Ishizaki (2004): The Japanese FrameNet project: An introduction. In Proceedings of the LREC Workshop on "Building Lexical Resources from Semantically Annotated Corpora".

• English
• German
• Spanish
• Japanese

• Paul Kingsbury and Martha Palmer (2002): From Treebank to PropBank. In Proceedings of the 3rd International Conference on Language Resources and Evaluation. Las Palmas de Gran Canaria, Spain.
• Martha Palmer, Dan Gildea, and Paul Kingsbury (2005): The Proposition Bank: A corpus annotated with semantic roles. Computational Linguistics, 31(1):71-106.
• Olga Babko-Malaya (2005): PropBank annotation guidelines. Manuscript.
• Olga Babko-Malaya (2005): Guidelines for PropBank framers. Manuscript.
• PropBank online
• NomBank online

• Invited talk by Eduard Hovy at LREC 2006: Corpus creation by annotation. Genoa, Italy.
• Eduard Hovy, Mitchell Marcus, Martha Palmer, Lance Ramshaw, and Ralph Weischedel (2006): OntoNotes: The 90% Solution. In Proceedings of the Human Language Technology of the North American Chapter of the Association for Computational Linguistics. New York City, NY.
• OntoBank online: link not yet available, check Eduard Hovy's website

• Nancy Ide and Jean Véronis (1998): Introduction to the special issue on Word Sense Disambiguation: The state of the art. Computational Linguistics, 24(1):1-40.
• Adam Kilgarriff and Martha Palmer (2000): Introduction to the special issue on SENSEVAL. Computers and the Humanities, 34(1-2):1-13.
• Philip Edmonds and Adam Kilgarriff (2002): Introduction to the special issue on evaluating Word Sense Disambiguation systems. Journal of Natural Language Engineering, 8(4).
• Xavier Carreras and Lluís Màrquez (2004,2005): Introduction to the CoNLL shared task: semantic role labeling (2004,2005). Conferences on Natural Language Learning.
• SENSEVAL online

Exercise: SALTO Annotation Tool

• SALSA project homepage
• SALTO download
• Aljoscha Burchardt, Katrin Erk, Anette Frank, Andrea Kowalski, and Sebastian Pado (2006): SALTO - A versatile multi-level annotation tool. In Proceedings of the 5th International Conference on Language Resources and Evaluation. Genoa, Italy.
• SALSA Project Saarbrücken (2006): Documentation of SALTO (aka SALSA tool). Manuscript.
• TIGERSearch project and manual

More Levels of Corpus Annotation

• Eva Hajicová (1999): The Prague Dependency Treebank: Crossing the sentence boundary. In Proceedings of the 2nd Workshop on Text, Speech, Dialogue, pp. 20-27. Mariánské Lázne, Czech Republic.
• Eva Hajicová, Jarmila Panevová, and Petr Sgall (2000): Coreference in annotating a large corpus. In Proceedings of the 2nd International Conference on Language Resources and Evaluation, pp. 497-500. Athens, Greece.
• Oana Postolache, Ivana Kruijff-Korbayová, and Geert-Jan Kruijff (2005): Data-driven approaches for information structure identification. In Proceedings of the joint Conference on Human Language Technology and Empirical Methods in Natural Language Processing, pp. 9-16. Vancouver, Canada.
• PDT online

• William C. Mann and Sandra A. Thompson (1988): Rhetorical Structure Theory: Toward a functional theory of text organization. Text, 8(3):243-281.
• Maite Taboada and William C. Mann (2006, to appear): Rhetorical Structure Theory: Looking back and moving ahead. Discourse Studies, 8(3).
• Maite Taboada and William C. Mann (2006, to appear): Applications of Rhetorical Structure Theory. Discourse Studies.
• RST online

• Eleni Miltsakaki, Rashmi Prasad, Aravind Joshi, and Bonnie Webber (2004): The Penn Discourse TreeBank. In Proceedings of the 4th International Conference on Language Resources and Evaluation. Lisbon, Portugal.
• Eleni Miltsakaki, Rashmi Prasad, Aravind Joshi, and Bonnie Webber (2004): Annotating discourse connectives and their arguments. In Proceedings of the HLT/NAACL Workshop on "Frontiers in Corpus Annotation". Boston, MA.
• Eleni Miltsakaki, Nikhil Dinesh, Rashmi Prasad, Aravind Joshi, and Bonnie Webber (2005): Experiments on sense annotations and sense disambiguation of discourse connectives. In Proceedings of the 4th Workshop on "Treebanks and Linguistic Theories". Barcelona, Spain.
• Bonnie Webber, Aravind Joshi, Eleni Miltsakaki, Rashmi Prasad, Nikhil Dinesh, Alan Lee, and Kate Forbes (2005): A short introduction to the Penn Discourse TreeBank. In Copenhagen Working Papers in Language and Speech Processing.
• Bonnie Webber, Matthew Stone, Aravind Joshi, and Alistair Knott (2001): Anaphora and discourse structure. Computational Linguistics, 29(4):545-587.
• The PDTB Research Group (2006): The Penn Discourse TreeBank 1.0. Annotation Manual. IRCS Technical Report IRCS-06-01, Institute for Research in Cognitive Science, University of Pennsylvania.
• PDTB online

• Ruslan Mitkov, Richard Evans, Constantin Orasan, Catalina Barbu, Lisa Jones, and Violeta Sotirova (2000): Coreference and anaphora: Developing annotating tools, annotated resources and annotation strategies. In Proceedings of the Discourse, Anaphora and Reference Resolution Conference, pp. 49-58. Lancaster, UK.
• Eva Hajicová, Jarmila Panevová, and Petr Sgall (2000): Coreference in annotating a large corpus. In Proceedings of the 2nd International Conference on Language Resources and Evaluation, pp. 497-500. Athens, Greece.
• Erhard Hinrichs, Sandra Kübler, Karin Naumann, Heike Telljohann, Julia Trushkina, and Heike Zinsmeister (2005): Recent developments in linguistic annotations of the TüBa-D/Z Treebank. Poster at the 27th Annual Meeting of the German Linguistic Society (Deutsche Gesellschaft für Sprachwissenschaft). Köln, Germany.

• Benno Peters (2005): The database `The Kiel Corpus of Spontaneous Speech'. In Klaus J. Kohler, Felicitas Kleber, Benno Peters, editors: "Arbeitsberichte des Instituts für Phonetik und digitale Sprachverarbeitung der Universität Kiel: Prosodic Structures in German Spontaneous Speech", no. 35a, pp. 1-6.
• Caren Brinckmann (2005): The Kiel Corpus of Read Speech as a resource for prosody prediction in speech synthesis. In Proceedings of the 2nd Baltic Conference on Human Language Technologies. Tallinn, Estonia.
• Jonathan Harrington: The phonetic analysis of speech corpora. Manuscript. Parts available online.
• Kiel Corpus online

• Jean Carletta and Amy Isard (1999): The MATE annotation workbench: User requirements. In Proceedings of the ACL Workshop on "Towards Standards and Tools for Discourse Tagging".
• David McKelvie, Amy Isard, Andreas Mengel, Morten Baun Moller, Michael Grosse, and Marion Klein (2001): The MATE workbench - An annotation tool for XML coded speech corpora. In Speech Communication, 33(1-2):97-112. Special issue on "Speech Annotation and Corpus Tools".
• MATE online

• Niels Ole Bernsen, Laila Dybkjaer, and Mykola Kolodnytsky (2002): The NITE workbench - A tool for annotation of natural interactivity and multimodal data. In Proceedings of the 3rd International Conference on Language Resources and Evaluation, Las Palmas de Gran Canaria, Spain.
• Niels Ole Bernsen, Laila Dybkjaer, and Mykola Kolodnytsky (2002): An interface for annotating natural interactivity. In Jan van Kuppevelt and Ronnie W. Smith, editors: "Current and New Directions in Discourse and Dialogue". Kluwer Academic Publishers.
• NITE online