When you have finished annotating a document, you need to check your
annotations. I suggest that you do this after taking a break, possibly
until the next day.
Double check that:
- No ids are missing in the agent, dse, ose, and
expressive-subjectivity annotations.
- Ids for a given agent match wherever that agent is referred to in
annotation features. (Check for typos.)
- Make sure that polarity and intensity are specified where needed.
- You didn't miss any annotations for private
state/speech events or expressive subjective elements.
A good way to check your annotations is to (a) sort the list of
annotations in the Annotations frame by starting byte, (b) select the
first annotation, (c) step down through the annotation list using the
arrow key. As you step through the annotations in this fashion, the
non-zero-span annotations will flash when they are selected. Check
one annotation at a time.
Alternatively, try running the MPQA Annotation Checker. The instructions are at:
http://www.cs.pitt.edu/mpqa/opinion-annotations/gate-instructions/checkerinstr.html.
Last updated 4 May 2008
J. Ruppenhofer