Python 获取 Javascript 变量的值

Question

我正在抓取 instagram 页面 ( https://instagram.com/celmirashop ) 并获取脚本(HTML 和一些 javascript)。结果是这样的

<script>some script</script>
<script>some script</script>
<script>some script</script>
<script>window._sharedData = {"config":{"csrf_token":"sSqrj6c8tfN1HwOIlwmpqONT2bAPhtNu","viewer":null etc....</script>

我已经创建了这样的脚本

import urllib.request
import json
import re
from bs4 import BeautifulSoup

web = urllib.request.urlopen("https://instagram.com/celmirashop")
soup = BeautifulSoup(web.read(), 'lxml')
pattern = re.compile(r"window._sharedData = .")
script = soup.find("script",text=pattern)
print(script)

并给我一个我想要的特定 javascript 的结果。像这样

<script>window._sharedData = {"config":{"csrf_token":"sSqrj6c8tfN1HwOIlwmpqONT2bAPhtNu","viewer":null etc....</script>

如何获取 window._sharedData 的值？并循环它。因为我想保存在mysql中

Answer 1

假设以 ; 结尾并且仅在您可以在 response.text 上使用以下正则表达式模式时发生

import re

s = '''<script>window._sharedData = {"config":{"csrf_token":"sSqrj6c8tfN1HwOIlwmpqONT2bAPhtNu","viewer":null"};</script>'''
p = re.compile(r'window\._sharedData = (.*);')
print(p.findall(s)[0])