用于查找唯一单词数/总单词数的 Python 函数不起作用...为什么？

Question

为什么这段代码不起作用？

def hapax_legomana_ratio(text):
''' Return the hapax_legomana ratio for this text.
This ratio is the number of words that occur exactly once divided
by the total number of words.
text is a list of strings each ending in \n.
At least one line in text contains a word.'''

uniquewords=dict()
words=0
for line in text:
    line=line.strip().split()
    for word in line:
        words+=1
        if word in words:
            uniquewords[word]-=1
        else:
            uniquewords[word]=1
HLR=len(uniquewords)/words

print (HLR)

当我测试它时，它给了我错误的答案。例如，当 9 个字符串中有 3 个唯一单词时，它给出的是 0.20454545454545456 而不是 .33333。

Answer 1

要查找文本中唯一单词数与单词总数的比率:

from collections import Counter

def hapax_legomana_ratio(text):
    words = text.split() # a word is anything separated by a whitespace
    return sum(count == 1 for count in Counter(words).values()) / len(words)

它假设text是一个字符串。如果您有一个行列表，那么您可以获得 words 列表，如下所示:

words = [word for line in all_lines for word in line.split()]