python - 无法从网络获取下载链接

Question

我尝试从该网站下载所有报告:https://www.opec.org/opec_web/en/publications/4814.htm但我无法自动找到美丽汤和请求的链接。有人可以帮助我吗？

到目前为止我已经尝试过以下代码:

from bs4 import BeautifulSoup

from urllib.request import Request, urlopen
import re

req = Request("https://www.opec.org/opec_web/static_files_project/media")
html_page = urlopen(req)

soup = BeautifulSoup(html_page, "lxml")

links = []

for link in soup.findAll('a'):

    print(link.get('href'))

Answer 1

你的代码应该是这样的

如果是 html 文档，则应使用“html.parser”，并且应链接到请求中的正确 url。

from bs4 import BeautifulSoup

from urllib.request import Request, urlopen
import re

req = Request("https://www.opec.org/opec_web/en/publications/4814.htm")
html_page = urlopen(req)

soup = BeautifulSoup(html_page, "html.parser")

links = []

for link in soup.findAll('a'):
    href = link.get('href')
    if 'pdf' in href:
        print(href)