python - iter_content() 函数到底做了什么？

Question

刚刚从自动化无聊的东西书上学习了网页抓取，但我仍然对 iter_content 函数感到困惑？它实际上做了什么？

尝试使用正常方式下载网页:

note = open('download.txt', 'w')
note.write(request)
note.close()

但结果与使用不同:

note = open('download.txt', 'wb')
for chunk in request.iter_content(100000):
    note.write(chunk)
note.close()

???

Answer 1

iter_content(chunk_size=1, decode_unicode=False)

Iterates over the response data. When stream=True is set on the request, this avoids reading the content at once into memory for large responses. The chunk size is the number of bytes it should read into memory. This is not necessarily the length of each item returned as decoding can take place.

chunk_size must be of type int or None. A value of None will function differently depending on the value of stream. stream=True will read data as it arrives in whatever size the chunks are received. If stream=False, data is returned as a single chunk.

If decode_unicode is True, content will be decoded using the best available encoding based on the response.

链接 - http://docs.python-requests.org/en/master/api/

在这种情况下，它将每次迭代 100000 字节的响应。