python - 无法从 python 搜索标签，但可以在 chrome 中查看

Question

无法搜索此 URL 内的以下标签

class="iw_component" id="c1417094965155"

我可以从桌面 Chrome 浏览器查看它，但在执行以下 python 脚本时无法读取它

import time
from selenium import webdriver
from pyvirtualdisplay import Display

display=Display(visible=0,size=(800,800))
display.start()

driver=webdriver.Firefox()
driver.get('url')
time.sleep(5)
title=driver.page_source
print title
driver.close()
display.stop()

Answer 1

您可以使用类名来定位元素 find_elements_by_class_name :

divs = driver.find_elements_by_class_name("iw_component")
for div in divs:  # use a descriptive variable name
    html_id = div.get_attribute("id")
    ...

<小时/>

此外，代替 time.sleep(5) 来模拟/延迟 python 等待直到所有元素都加载完毕，Explicit Waits可用于等待特定元素:

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

driver = webdriver.Firefox()
driver.get("http://somedomain/url_that_delays_loading")
try:
    element = WebDriverWait(driver, 10).until(
        EC.presence_of_element_located((By.ID, "myDynamicElement"))
    )
finally:
    driver.quit()

对于您来说，定位器策略的部分是:

presence_of_element_located((By.CLASS_NAME, "iw_component"))