We use a few cookies

Essential cookies keep the library working. With your permission, we'd also like to use analytics to see what's useful and improve the experience. Read our Privacy Policy or Cookie Policy.

Skip to main content
Home/e-Resources/Artificial Intelligence & Machine Learning/Scoring Coreference Partitions of Predicted Mentions: A Reference Implementation
Conference ProceedingsArtificial Intelligence & Machine Learning

Scoring Coreference Partitions of Predicted Mentions: A Reference Implementation

Checking your access to this record.

Abstract & Overview

) mentions. Several variations have been proposed that manipulate either, or both, the key and predicted mentions in order to get a one-to-one mapping. On the other hand, the metric BLANC was, until recently, limited to scoring partitions of key mentions. In this paper, we (i) argue that mention manipulation for scoring predicted mentions is unnecessary, and potentially harmful as it could produce unintuitive results; (ii) illustrate the application of all these measures to scoring predicted mentions; (iii) make available an open-source, thoroughly-tested reference implementation of the main coreference evaluation measures; and (iv) rescore the results of the CoNLL-2011/2012 shared task systems with this implementation. This will help the community accurately measure and compare new end-to-end coreference resolution algorithms.

Cite this record

Sameer Pradhan, Xiaoqiang Luo, Marta Vilar Recasens, Eduard H. Hovy, Vincent Ng, Michael Strube (2014). Scoring Coreference Partitions of Predicted Mentions: A Reference Implementation. Annual Meeting of the Association for Computational Linguistics (ACL). https://doi.org/10.3115/v1/p14-2006

Copy in another style

Pradhan, S., Luo, X., Recasens, M. V., Hovy, E. H., Ng, V., & Strube, M. (2014). Scoring Coreference Partitions of Predicted Mentions: A Reference Implementation. Annual Meeting of the Association for Computational Linguistics (ACL). https://doi.org/10.3115/v1/p14-2006
Author names are used as deposited, so check their order before you submit.

Metadata is harvested from open-access indexes and can be incomplete. Check a citation against the published version before relying on it — see our open access & attribution policy.