python - 无法从类中抓取文本 (BeautifulSoup)

Question

我在从乐透抽奖网站获取数据进行统计时遇到问题，我尝试了一堆不同的解析器，但每次它返回的内容都是“无”

import requests
from bs4 import BeautifulSoup

url = "https://www.opap.gr/lotto-draw-results"
user = {"User-Agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36"}
req = requests.get(url, headers = user)
soup = BeautifulSoup(req.text, "html.parser")
i = 1
while i <= 6:
    for draw_num in soup.findAll("li", {"class": "draw-result-number-{}".format(i)}):
        print(draw_num.content)
        i += 1

网站上的一段html代码:

<ul class="circles"> <li class="draw-result-number-1">1</li> <li class="draw-result-number-2">2</li> <li class="draw-result-number-3">12</li> <li class="draw-result-number-4">14</li> <li class="draw-result-number-5">20</li> <li class="draw-result-number-6">49</li> <span class="plus_symbol" style="display: inline;">+</span> <li class="highlighted draw-result-number-bonus" style="display: inline-block;">8</li> </ul>

如果您能帮助我，我将不胜感激。

Answer 1

从外观上看，数据并未嵌入 html 中，而是通过额外的 API 调用检索:

https://api.opap.gr/draws/v3.0/5103/last-result-and-active?status=results

您可以解析它以获得中奖号码:

import requests
req = requests.get("https://api.opap.gr/draws/v3.0/5103/last-result-and-active?status=results")
data = req.json() 
print(data["last"]["winningNumbers"])

看起来url路​​径是静态的，在JS中它是动态构建url的，5103意味着它是Lotto游戏，参见this file