Paper check About

The Stanford CoreNLP Natural Language Processing Toolkit

Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 2014 · paper · Computational linguistics

Describes the design and use of Stanford CoreNLP, an extensible pipeline providing core language analysis from tokenization to coreference resolution. The authors attribute its wide use to a simple design, straightforward interfaces, good-quality components and minimal extra baggage.

Checked: PDF from aclanthology.org, fetched 5 Oct 2026. Page numbers are those of that PDF.

2 findings

Reference or label Figure 3 names the main class "edu.stanford.nlp.StanfordCoreNLP", while Appendix C runs "edu.stanford.nlp.pipeline.StanfordCoreNLP" and Figure 4 imports the class from "edu.stanford.nlp.pipeline.*"; Figure 3 lacks the "pipeline" package.
  • p. 3 Figure 3, command line
    edu.stanford.nlp.StanfordCoreNLP
  • p. 5 Appendix C, command line
    edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators
  • p. 3 Figure 4, imports
    import edu.stanford.nlp.pipeline.*;

Judge's note: Read Figure 3 on the page 3 image: the class name is on one line, "edu.stanford.nlp.StanfordCoreNLP", with no "pipeline" component. Appendix C on page 5 prints "edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators", Figure 4 has "import edu.stanford.nlp.pipeline.*;" and page 5 names "edu.stanford.nlp.pipeline.Annotator". Nothing in the paper mentions a second class of that name in the parent package. The paper is inconsistent with itself on the fully qualified class name; the fix is evident from its own other uses.

Second check: another model agreed

Report a problem with this finding
Wording Section 5 says "An Annotator is a class that implements three methods" (annotate, requirementsSatisfied, requires), but the Figure 5 example on the same page defines only annotate and comments "// this is the only method an Annotator must implement".
  • p. 4 Figure 5, code comment
    // this is the only method an Annotator must implement
  • p. 4 Section 5, first paragraph
    is a class that implements three methods: a sin-
  • p. 4 Figure 5 code comment
    this is the only method an Annotator must implement
  • p. 4 Section 5, first paragraph
    An Annotator is a class that implements three methods

Only the authors can say what is right here.

Judge's note: Read both on the page 4 image. The text lists three signatures: "public void annotate(Annotation annotation); public Set<Requirement> requirementsSatisfied(); public Set<Requirement> requires();". Figure 5's class "GazetteerLocationAnnotator implements Annotator" contains only annotate(), with the quoted comment. The paper nowhere says the other two methods have defaults or are optional, so the two statements disagree as printed. Which is right for the described version is for the authors to say.

Second check: another model agreed

Report a problem with this finding
6 minor (typos and the like; most checked by the judge only)
Wording Section 5 (page 5): "the user extends the class edu.stanford.nlp.pipeline.Annotator", while Figure 5 declares "public class GazetteerLocationAnnotator implements Annotator" and Section 2 calls it "A uniform interface".
  • p. 5 Section 5 (continued), first paragraph
    vide a new Annotator, the user extends the class
  • p. 4 Figure 5, class declaration
    public class GazetteerLocationAnnotator implements Annotator {
  • p. 1 Section 2
    A uniform interface was provided for an Annota-
  • p. 5 Section 5, continuation paragraph at top of left column
    the user extends the class

Judge's note: Page 5 image shows "To provide a new Annotator, the user extends the class edu.stanford.nlp.pipeline.Annotator and provides a constructor with the signature (String, Properties)". Figure 5 on page 4 uses "implements Annotator" and shows no such constructor. "Extends" may be used loosely for providing a subtype, so this is a wording inconsistency between text and example, not a clear error.

Second check: another model agreed

Report a problem with this finding
Wording Figure 3, first line: "export StanfordCoreNLP_HOME /where/installed" has no "=" between the variable name and its value, although the next line uses "$StanfordCoreNLP_HOME".
  • p. 3 Figure 3, first line
    export StanfordCoreNLP_HOME /where/installed

Only the authors can say what is right here.

Judge's note: Rests on outside knowledge: in Bourne-type shells export takes NAME=value, and the space-separated form belongs to csh's setenv. The page 3 image and crop show a space and no "=" in the line, so this is not an extraction loss. The figure is captioned "Minimal command-line invocation" and the following line is literal shell. Whether the intended form is "export NAME=value" or "setenv NAME value" is for the authors; it could also be meant schematically.

Second check: another model agreed

Report a problem with this finding
Typo Section 1, first sentence: "This paper describe the design and development of Stanford CoreNLP" should read "This paper describes".
  • p. 1 Section 1 Introduction, first sentence
    This paper describe the design and development of

Judge's note: Page 1 image shows "This paper describe" on one line with no trailing s and no line break in the word. Subject-verb disagreement; meaning unaffected.

Second check: none (judge only)

Report a problem with this finding
Typo Section 4, first sentence: "The annotators provided with StanfordCoreNLP" writes the toolkit name as one word in body roman type; elsewhere in the prose it is "Stanford CoreNLP".
  • p. 3 Section 4, first sentence
    The annotators provided with StanfordCoreNLP

Judge's note: The crop shows "StanfordCoreNLP" set in the body serif face, not the typewriter or sans face used for class names elsewhere, and the sentence is about the toolkit's annotators. The one-word form is also the Java class name, so a deliberate reference to the class cannot be excluded. Cosmetic.

Second check: none (judge only)

Report a problem with this finding
Typo Appendix C, sample input shown by "cat sentiment.txt": "The plot move rather slowly." (subject-verb disagreement; "moves" expected).
  • p. 5 Appendix C, sentiment.txt contents
    The plot move rather slowly.

Judge's note: The page 5 image shows the line as quoted. It is the printed content of an input file in a terminal transcript, so it may be the literal file contents; the other two sample sentences are well-formed. Cosmetic, and either reading is consistent with the output on page 6.

Second check: none (judge only)

Report a problem with this finding
Typo References, Hahn et al. 2008: "U. Hahn, E. Buyko, R. Landefeld, M. Mühlhausen, Poprat M, K. Tomanek, and J. Wermter" prints one author surname-first without a full stop; it should read "M. Poprat".
  • p. 6 References, Hahn et al. 2008
    Poprat M, K. Tomanek, and J. Wermter. 2008.
  • p. 6 References, Hahn et al. 2008
    Poprat M, K. Tomanek

Judge's note: The page 6 image shows "Poprat M," in that order, while every other author in the entry is initial then surname. Formatting slip within the entry; the fix follows from the entry's own style.

Second check: none (judge only)

Report a problem with this finding
Something wrong with this page, or a finding we missed?