python - 从文本列表中删除单词

Question

我试图从文本字符串列表中删除某些单词(除了使用停用词之外)，但由于某种原因它不起作用

documents = ["Human machine interface for lab abc computer applications",
         "A survey of user opinion of computer system response time",
         "The EPS user interface management system",
         "System and human system engineering testing of EPS",
         "Relation of user perceived response time to error measurement",
         "The generation of random binary unordered trees",
         "The intersection graph of paths in trees",
         "Graph minors IV Widths of trees and well quasi ordering",
         "Graph minors A survey"]

exclude = ['am', 'there','here', 'for', 'of', 'user']

new_doc = [word for word in documents if word not in exclude]

print new_doc

输出

['Human machine interface for lab abc computer applications', 'A survey of user opinion of computer system response time', 'The EPS user interface management system', 'System and human system engineering testing of EPS', 'Relation of user perceived response time to error measurement', 'The generation of random binary unordered trees', 'The intersection graph of paths in trees', 'Graph minors IV Widths of trees and well quasi ordering', 'Graph minors A survey']

如您所见，没有从 DOCUMENTS 中删除 EXCLUDE 中的任何单词(例如“for”就是一个典型示例)

它适用于这个运算符:

new_doc = [word for word in str(documents).split() if word not in exclude]

但是我该如何取回 DOCUMENTS 中的初始元素(尽管是“已清理的元素”)？

非常感谢您的帮助!

Answer 1

您应该在过滤之前将行拆分为单词:

new_doc = [' '.join([word for word in line.split() if word not in exclude]) for line in documents]