python - 如果字符串包含停用词，则从字符串中删除元素

Question

这个问题已经有答案了:

How to remove items from a list that contains words found in items in another list [duplicate] (4 个回答)

已关闭 4 年前。

我有一个列表如下:

lst = ['for Sam', 'Just in', 'Mark Rich']

我正在尝试从字符串列表中删除一个元素(字符串包含一个或多个单词)，其中包含 stopwords .

列表中的第一个和第二个元素包含 for和in分别是stopwords ，它将返回

new_lst = ['Mark Rich'] 

我尝试过的

from nltk.corpus import stopwords

stop_words = set(stopwords.words('english'))

lst = ['for Sam', 'Just in', 'Mark Rich']
new_lst = [i.split(" ") for i in lst]
new_lst = [" ".join(i) for i in new_lst for j in i if j not in stop_words]

这给我的输出为:

['for Sam', 'Just in', 'Mark Rich', 'Mark Rich']

Answer 1

您需要一个 if 语句，而不是额外的嵌套:

new_lst = [' '.join(i) for i in new_lst if not any(j in i for j in stop_words)]

如果您想使用set，您可以使用set.isdisjoint :

new_lst = [' '.join(i) for i in new_lst if stop_words.isdisjoint(i)]

<小时/>

这是一个演示:

stop_words = {'for', 'in'}

lst = ['for Sam', 'Just in', 'Mark Rich']
new_lst = [i.split() for i in lst]
new_lst = [' '.join(i) for i in new_lst if stop_words.isdisjoint(i)]

print(new_lst)

# ['Mark Rich']