machine-learning - Spacy - 代词词形还原会产生一些错误的输出

Question

通过 [token.lemma_ for token in doc] 对代词进行词形还原，将代词词形化为 -PRON-，这是一个错误吗？

Answer 1

不，这实际上是有意为之的行为。请参阅文档 here :

Unlike verbs and common nouns, there's no clear base form of a personal pronoun. Should the lemma of "me" be "I", or should we normalize person as well, giving "it" — or maybe "he"? spaCy's solution is to introduce a novel symbol, -PRON-, which is used as the lemma for all personal pronouns.

可能值得注意的是，随着 spaCy 朝着与 Universal Dependencies 更好的兼容性方向发展，该约定在未来可能会发生变化。格式。