Skip to content

CRAFT v3.1
Compare
Choose a tag to compare
@bill-baumgartner bill-baumgartner released this 08 Apr 19:42
· 60 commits to master since this release
v3.1
83c2012
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

The changes detailed below were prompted in part by preparation of the CRAFT corpus for the CRAFT Shared Task.

Changes for v3.1

  • The top-level directory has been reorganized into three main directories for annotations.

    • concept_annotation/ stores all annotations of ontology concept mentions
    • structural_annotation/ stores all syntactic annotations and annotations related to document structure
    • coreference_annotation/ stores all coreference annotations

  • A Clojure Boot script has been added to the distribution to facilitate dynamic generation of annotation files in different formats at a user's request. With this addition, annotation files in alternative formats (e.g. brat, uima, knowtator-2 etc.) have been removed leaving only the native file format for each annotation type. Doing so has reduced the overall size of the CRAFT project to under the 1GB threshold imposed by GitHub.

  • Knowtator-2 project archives have been removed from the distribution. They can now be created dynamically using the new Clojure Boot script.

  • Some treebank files have been adjusted based on errors reported by the CoNLL 2018 universal dependency shared task evaluation script (http://universaldependencies.org/conll18/evaluation.html) when run over dependency parses derived from the treebank files. Most errors took the form of multiple ROOT nodes present in the dependency parse and were related to nested CAPTION constructs in the treebank files. These were addressed by un-nesting the CAPTION constructs. There were also a few errors related to empty forms in the resulting dependency parses. These stemmed from lists in the treebank files that used empty forms, e.g. (: ) or (SYM ) and these were removed from the treebank files.

  • New versions of the dependency files have been derived from the manually annotated treebank files using the ClearNLP library, specifically the C2DConvert.java application (https://github.com/clir/clearnlp/blob/master/src/main/java/edu/emory/clir/clearnlp/bin/C2DConvert.java). The file format for the dependency files has also been updated to use the CoNLL-U file format (https://universaldependencies.org/format.html). The original versions of the dependency files have been removed from the repository.

  • Some erroneous relations were removed from a single knowtator-2 annotation file for the CL+extension concepts

  • The coreference annotations have been revised to resolve instances of identity chains sharing mentions. The original knowtator files have been removed and replaced with knowtator-2 format files that contain the revised annotations. For details on the changes to the coreference annotations, please see this README.

  • The distribution now includes XSD files for the knowtator and knowtator-2 XML file formats. See the schema/ directory

Assets 2
Loading