python - 如何在 python 中同时执行批量请求？

Question

我正在使用 Reddit api 为一些 subreddits 投票。我想使用 praw 库与 reddit api 交互，同时对多个 subreddit 进行投票。

我要为/r/bookclub的27个“热门”和“上升”帖子点赞:

subreddit = reddit.subreddit("bookclub")

for submission in subreddit.hot(limit=27):
    submission.upvote()

for submission in subreddit.rising(limit=27):
    submission.upvote()

我想使用异步或多处理来更快地完成此操作。我使用 grequests 库一次完成所有 .upvote()，到目前为止它正在工作，但我不确定它是否真的更好:

subreddit = reddit.subreddit("bookclub")

hot_upvotes = (grequests.get(submission.upvote()) for submission in subreddit.hot(limit=27))
grequests.map(hot_upvotes)

rising_upvotes = (grequests.get(submission.upvote()) for submission in subreddit.rising(limit=27))
grequests.map(rising_upvotes)

两个版本都对 Reddit 子版 block 进行了投票。我想知道是否可以同时运行 hot_upvotes 和 rising_upvotes 部分？

Answer 1

from threading import Thread
import functools

subreddit = reddit.subreddit("bookclub")

def run_hot_upvotes(subreddit):
    hot_upvotes = (grequests.get(submission.upvote()) for submission in subreddit.hot(limit=27))
    grequests.map(hot_upvotes)

def run_rising_upvotes(subreddit):
    rising_upvotes = (grequests.get(submission.upvote()) for submission in subreddit.rising(limit=27))
    grequests.map(rising_upvotes)

Thread(target = functools.partial(run_rising_upvotes, subreddit)).start()
Thread(target = functools.partial(run_hot_upvotes, subreddit)).start()

尝试以下方法让两者同时运行，每个都在自己的线程中运行。