What is adjudication?

The SALSA tool supports adjudication of corpora that have been independently annotated by two annotators.

Merging

In a first step, the two corpora are merged. The output of this step is a single corpus that integrates the annotations of both annotators, including the explicit representation of divergences. That is, annotations that are identical in both corpora will be represented as such in the resulting corpus. Annotation differences will be represented as disjunctive.

Adjudication

In the second step, an adjudicator investigates the marked differences, and resolves the divergences. The tool supports the process of selecting one or the other of the diverging annotations. At the same time, it offers all the standard annotation facilities. That is, in cases where neither of the two annotations are acceptable, both versions can be deleted and substituted by another annotation. In the same way, if the divergences motivate the need to underspecify the distinct readings, underspecification of frames and frame elements can be specified as usual (see 6.4).