The Stanford CoreNLP Natural Language Processing Toolkit
Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 2014 · paper · Computational linguistics
Describes the design and use of Stanford CoreNLP, an extensible pipeline providing core language analysis from tokenization to coreference resolution. The authors attribute its wide use to a simple design, straightforward interfaces, good-quality components and minimal extra baggage.
Checked: PDF from aclanthology.org, fetched 5 Oct 2026. Page numbers are those of that PDF.
2 findings
Reference or label Figure 3 names the main class "edu.stanford.nlp.StanfordCoreNLP", while Appendix C runs "edu.stanford.nlp.pipeline.StanfordCoreNLP" and Figure 4 imports the class from "edu.stanford.nlp.pipeline.*"; Figure 3 lacks the "pipeline" package.
- p. 3 Figure 3, command line
edu.stanford.nlp.StanfordCoreNLP
- p. 5 Appendix C, command line
edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators
- p. 3 Figure 4, imports
import edu.stanford.nlp.pipeline.*;
Judge's note: Read Figure 3 on the page 3 image: the class name is on one line, "edu.stanford.nlp.StanfordCoreNLP", with no "pipeline" component. Appendix C on page 5 prints "edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators", Figure 4 has "import edu.stanford.nlp.pipeline.*;" and page 5 names "edu.stanford.nlp.pipeline.Annotator". Nothing in the paper mentions a second class of that name in the parent package. The paper is inconsistent with itself on the fully qualified class name; the fix is evident from its own other uses.
Second check: another model agreed
Report a problem with this finding
Wording Section 5 says "An Annotator is a class that implements three methods" (annotate, requirementsSatisfied, requires), but the Figure 5 example on the same page defines only annotate and comments "// this is the only method an Annotator must implement".
- p. 4 Figure 5, code comment
// this is the only method an Annotator must implement
- p. 4 Section 5, first paragraph
is a class that implements three methods: a sin-
- p. 4 Figure 5 code comment
this is the only method an Annotator must implement
- p. 4 Section 5, first paragraph
An Annotator is a class that implements three methods
Only the authors can say what is right here.
Judge's note: Read both on the page 4 image. The text lists three signatures: "public void annotate(Annotation annotation); public Set<Requirement> requirementsSatisfied(); public Set<Requirement> requires();". Figure 5's class "GazetteerLocationAnnotator implements Annotator" contains only annotate(), with the quoted comment. The paper nowhere says the other two methods have defaults or are optional, so the two statements disagree as printed. Which is right for the described version is for the authors to say.
Second check: another model agreed
Report a problem with this finding
6 minor (typos and the like; most checked by the judge only)
Wording Section 5 (page 5): "the user extends the class edu.stanford.nlp.pipeline.Annotator", while Figure 5 declares "public class GazetteerLocationAnnotator implements Annotator" and Section 2 calls it "A uniform interface".
- p. 5 Section 5 (continued), first paragraph
vide a new Annotator, the user extends the class
- p. 4 Figure 5, class declaration
public class GazetteerLocationAnnotator implements Annotator {
- p. 1 Section 2
A uniform interface was provided for an Annota-
- p. 5 Section 5, continuation paragraph at top of left column
the user extends the class
Judge's note: Page 5 image shows "To provide a new Annotator, the user extends the class edu.stanford.nlp.pipeline.Annotator and provides a constructor with the signature (String, Properties)". Figure 5 on page 4 uses "implements Annotator" and shows no such constructor. "Extends" may be used loosely for providing a subtype, so this is a wording inconsistency between text and example, not a clear error.
Second check: another model agreed
Report a problem with this finding
Wording Figure 3, first line: "export StanfordCoreNLP_HOME /where/installed" has no "=" between the variable name and its value, although the next line uses "$StanfordCoreNLP_HOME".
- p. 3 Figure 3, first line
export StanfordCoreNLP_HOME /where/installed
Only the authors can say what is right here.
Judge's note: Rests on outside knowledge: in Bourne-type shells export takes NAME=value, and the space-separated form belongs to csh's setenv. The page 3 image and crop show a space and no "=" in the line, so this is not an extraction loss. The figure is captioned "Minimal command-line invocation" and the following line is literal shell. Whether the intended form is "export NAME=value" or "setenv NAME value" is for the authors; it could also be meant schematically.
Second check: another model agreed
Report a problem with this finding
Typo Section 1, first sentence: "This paper describe the design and development of Stanford CoreNLP" should read "This paper describes".
- p. 1 Section 1 Introduction, first sentence
This paper describe the design and development of
Judge's note: Page 1 image shows "This paper describe" on one line with no trailing s and no line break in the word. Subject-verb disagreement; meaning unaffected.
Second check: none (judge only)
Report a problem with this finding
Typo Section 4, first sentence: "The annotators provided with StanfordCoreNLP" writes the toolkit name as one word in body roman type; elsewhere in the prose it is "Stanford CoreNLP".
- p. 3 Section 4, first sentence
The annotators provided with StanfordCoreNLP
Judge's note: The crop shows "StanfordCoreNLP" set in the body serif face, not the typewriter or sans face used for class names elsewhere, and the sentence is about the toolkit's annotators. The one-word form is also the Java class name, so a deliberate reference to the class cannot be excluded. Cosmetic.
Second check: none (judge only)
Report a problem with this finding
Typo Appendix C, sample input shown by "cat sentiment.txt": "The plot move rather slowly." (subject-verb disagreement; "moves" expected).
- p. 5 Appendix C, sentiment.txt contents
The plot move rather slowly.
Judge's note: The page 5 image shows the line as quoted. It is the printed content of an input file in a terminal transcript, so it may be the literal file contents; the other two sample sentences are well-formed. Cosmetic, and either reading is consistent with the output on page 6.
Second check: none (judge only)
Report a problem with this finding
Typo References, Hahn et al. 2008: "U. Hahn, E. Buyko, R. Landefeld, M. Mühlhausen, Poprat M, K. Tomanek, and J. Wermter" prints one author surname-first without a full stop; it should read "M. Poprat".
- p. 6 References, Hahn et al. 2008
Poprat M, K. Tomanek, and J. Wermter. 2008.
- p. 6 References, Hahn et al. 2008
Poprat M, K. Tomanek
Judge's note: The page 6 image shows "Poprat M," in that order, while every other author in the entry is initial then surname. Formatting slip within the entry; the fix follows from the entry's own style.
Second check: none (judge only)