python - BeautifulSoup PYTHON - 内部标签

Question

BeautifulSoup 的小问题:

from bs4 import BeautifulSoup
import requests

link = "http://www.cnnvd.org.cn/web/vulnerability/querylist.tag"

req = requests.get(link)
web = req.text
soup = BeautifulSoup(web, "lxml")

cve_name = []
cve_link = []

for par_ in soup.find_all('div', attrs={'class':'fl'}):
    for link_ in par_.find_all('p'):
        for text_ in link_.find_all('a'):
            print (text_.string)
            print (text_['href'])
            print ("==========")
            #cve_name.append(text_.string)
            #cve_link.append(text_['href'])

它给了我两次记录:V 这可能很容易解决:V

Answer 1

相同的元素位于页面上的两个位置，因此您必须使用 find()/find_all() 来仅选择一个位置，即 find(class_ ='list_list') 中

soup.find(class_='list_list').find_all('div', attrs={'class':'fl'}):

完整代码:

from bs4 import BeautifulSoup
import requests

link = "http://www.cnnvd.org.cn/web/vulnerability/querylist.tag"

req = requests.get(link)
web = req.text
soup = BeautifulSoup(web, "lxml")

cve_name = []
cve_link = []


for par_ in soup.find(class_='list_list').find_all('div', attrs={'class':'fl'}):
    print(len(par_))
    for link_ in par_.find_all('p'):
        for text_ in link_.find_all('a'):
            print (text_.string)
            print (text_['href'])
            print ("==========")
            #cve_name.append(text_.string)
            #cve_link.append(text_['href'])