Release format

[kermitt2]

A candidate release with a compact encoding of the annotated data aligned with the Open Access PDF content (extracted by GROBID) can be found here:

https://github.com/Impactstory/software-mentions/blob/master/resources/dataset/software/corpus/all.clean.tei.xml

The file gives a format very easy to use by external parties, as compared to the RDF or CSV with only annotations but no context. It can directly be used to train an annotator.

Everything is conformant with TEI, with various metadata (like the GROBID versions), included some DOI/PMID/PMC injected to the annotated papers to fulfil the attribution requirement of CC-BY.

Additional manual corrections (more than one thousand) have been made to maintain a global consistency in the annotations, avoiding arbitrary variations from one annotator to another and missing annotations in the selected contexts. The additional annotation guidelines introduced for these corrections are described in a separate issue.