python - 在 Python 中使用 nltk 出现非 ASCII 字符错误

Question

我正在尝试使用以下链接中给出的解决方案代码:Unicode Tagging in Python NLTK

在omerbp给出的解决方案中:

from nltk.corpus import indian
from nltk.tag import tnt

train_data = indian.tagged_sents('hindi.pos')
tnt_pos_tagger = tnt.TnT()
tnt_pos_tagger.train(train_data) #Training the tnt Part of speech tagger with hindi data

print tnt_pos_tagger.tag(nltk.word_tokenize(word_to_be_tagged))

我收到以下错误:

'SyntaxError: Non-ASCII character '\xe0' in file q12.py on line 1, but no encoding declared; see http://www.python.org/peps/pep-0263.html for details' in line 1.

Answer 1

将这两行添加到文件顶部:

#!/usr/bin/python
# -*- coding: utf-8 -*-

它们将指示解释器将每个字符编码为 UTF-8 而不是 ASCII。