python - 在 Python 中同时执行多个任务

Question

以下代码一次可以从一个给定的 url 下载一个文件:

from selenium import webdriver

with open("url_lists.txt","r") as fi:  ###The text file contains hundreds of urls
    urls = fi.read().splitlines()

for url in urls:                    
    browser = webdriver.Firefox()           
    browser.get(url)    
    browser.find_element_by_id('download').click()

我想修改代码，让5个不同的浏览器同时打开5个url，同时下载5个文件。

我怎样才能完成它？

Answer 1

您可以使用线程。

#!/usr/bin/env python
#-*- coding:utf-8 -*-

from selenium import webdriver
from threading import Thread

with open("url_lists.txt","r") as fi:  ###The text file contains hundreds of urls
    urls = fi.read().splitlines()

def func(url, bro):

    browserFunc = getattr(webdriver, bro, webdriver.Firefox)
    browser = browserFunc()           
    browser.get(url)    
    browser.find_element_by_id('download').click()

t = []
urls = [1,2,3,4,5]
bros = [1,2,3,4,5]

for i in range(len(urls)):
    t.append(Thread(target=func, args=[urls[i], bros[i]]))
for i in t:
    t.start()
for i in t:
    t.join()


if __name__ == '__main__':

    a = test1()