python - 从脚本中提取 - BeautifulSoup

Question

“tier1Category”的值如何从此页面的源中提取？ https://www.walgreens.com/store/c/walgreens-wal-zyr-24-hour-allergy-tablets/ID=prod6205762-product

soup.find('script') 

仅返回源的一个子集，以下返回该代码中的另一个源。

json.loads(soup.find("script", type="application/ld+json").text)

Answer 1

Bitto 和我对此有类似的方法，但我宁愿不依赖于知道哪个脚本包含匹配模式，也不依赖于脚本的结构。

import requests
from collections import abc
from bs4 import BeautifulSoup as bs

def nested_dict_iter(nested):
    for key, value in nested.items():
        if isinstance(value, abc.Mapping):
            yield from nested_dict_iter(value)
        else:
            yield key, value

r = requests.get('https://www.walgreens.com/store/c/walgreens-wal-zyr-24-hour allergy-tablets/ID=prod6205762-product')
soup = bs(r.content, 'lxml')
for script in soup.find_all('script'):
    if 'tier1Category' in script.text:
        j = json.loads(script.text[str(script.text).index('{'):str(script.text).rindex(';')])
        for k,v in list(nested_dict_iter(j)):
             if k == 'tier1Category':
                 print(v)