python - 在 python 中使用 urllib2 和 Tor 拒绝连接

Question

我是 python 的新手。我正在尝试为我正在从事的项目编写一个非常简单的网络抓取工具。在此过程中，我尝试使用 Tor 更改我的 IP 地址，这样我就不会与正在抓取的服务断开连接。在将新 IP 添加到我的项目之前，我试图测试特定于获取新 IP 的代码。这是我正在测试的代码。

from TorCtl import TorCtl
import urllib2

for i in range(1,51):
    proxy_support = urllib2.ProxyHandler({"http" : "127.0.0.1:8118"} )
    opener = urllib2.build_opener(proxy_support)
    opener.addheaders = [('User-agent', 'Mozilla/5.0')]
    urllib2.install_opener(opener)

    print "IP " + str(i) + ":"
    print urllib2.urlopen('http://ifconfig.me/ip').read()

    conn = TorCtl.connect(controlAddr="127.0.0.1", controlPort=9051, passphrase="torPass")
    conn.sendAndRecv('signal newnymrn')
    conn.close()

当我这样做时，出现以下错误:

IP 1: Traceback (most recent call last): File "scrapingTools.py", line 86, in main() File "scrapingTools.py", line 76, in main print urllib2.urlopen('http://ifconfig.me/ip').read() File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 126, in urlopen return _opener.open(url, data, timeout) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 394, in open response = self._open(req, data) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 412, in _open '_open', req) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 372, in _call_chain result = func(*args) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 1199, in http_open return self.do_open(httplib.HTTPConnection, req) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 1174, in do_open raise URLError(err) urllib2.URLError:

如果能帮助理解这里发生的事情，我们将不胜感激。

Answer 1

您的代理配置存在一些问题。您的代码无需代理设置即可运行。