gpt4 book ai didi

python - 按字段名从表中提取数据。 Xpath, python

转载 作者:行者123 更新时间:2023-12-04 03:55:28 24 4
gpt4 key购买 nike

我想从此页面中提取数据https://mbasic.facebook.com/kristina.layus有一个包含两行的“Places lived”表

Current city --- Moscow, Russia
Home town --- Saint Petersburg, Russia

我可以借助完整的 xpath 提取数据(提取的数据“莫斯科,俄罗斯”):

/html/body/div/div/div[2]/div/div[1]/div[4]/div/div/div[1]/div/table/tbody/tr/td[2]/div/a

但我想借助表中的名称提取数据。我试过了

//div[@id='living']//div[@title='Current City']//a/text()

但是收到错误

NoSuchElementException: Message: no such element: Unable to locate element: {"method":"xpath","selector":"//div[@id='living']//div[@title='Current City']//a/text()"}
(Session info: chrome=84.0.4147.89)

我的代码

from selenium import webdriver
from selenium.common.exceptions import TimeoutException
from selenium.webdriver.common.by import By
from selenium.webdriver.support.wait import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

class FacebookParser:
LOGIN_URL = 'https://www.facebook.com/login.php'

def __init__(self, login, password):
chrome_options = webdriver.ChromeOptions()
prefs = {"profile.default_content_setting_values.notifications": 2}
chrome_options.add_experimental_option("prefs", prefs)

self.driver = webdriver.Chrome(chrome_options=chrome_options)
self.wait = WebDriverWait(self.driver, 10)
self.login(login, password)

def login(self, login, password):
self.driver.get(self.LOGIN_URL)

# wait for the login page to load
self.wait.until(EC.visibility_of_element_located((By.ID, "email")))

self.driver.find_element_by_id('email').send_keys(login)
self.driver.find_element_by_id('pass').send_keys(password)
self.driver.find_element_by_id('loginbutton').click()

def get_user_by_id(self, id):
self.driver.get(BASIC_URL + 'profile.php?id=' + str(id))

def get_user_by_url(self, url):
self.driver.get(url)

def find_element_by_xpath_safe(self, path):
try:
return parser.driver.find_element_by_xpath(path)
except:
return None

def get_first_name(self):
res = self.find_element_by_xpath_safe('//span/div/span/strong')
if res:
vec = res.text.split()
if len(vec) > 0:
return vec[0]
else:
print("Can't split {}".format(res.text))
return ""

def get_second_name(self):
res = self.find_element_by_xpath_safe('//span/div/span/strong')
if res:
vec = res.text.split()
if len(vec) > 1:
return vec[1]
else:
print("Can't split {}".format(res.text))
return ""

def get_curr_city(self):
res = self.find_element_by_xpath_safe('/html/body/div/div/div[2]/div/div[1]/div[4]/div/div/div[1]/div/table/tbody/tr/td[2]/div/a')
if res:
return res.text
return ""

def get_home_town(self):
res = self.find_element_by_xpath_safe('/html/body/div/div/div[2]/div/div[1]/div[4]/div/div/div[2]/div/table/tbody/tr/td[2]/div/a')
if res:
return res.text
return ""


#####################################
LOGIN = '----.com'
PASSWORD = '----'
BASIC_URL = 'https://mbasic.facebook.com/'
#####################################

parser = FacebookParser(login=LOGIN, password=PASSWORD)
parser.driver.get("https://mbasic.facebook.com/kristina.layus")


parser.driver.get("https://mbasic.facebook.com/kristina.layus")
print(parser.get_curr_city())

最佳答案

要打印文本 Moscow, Russia 你需要诱导 WebDriverWait对于 visibility_of_element_located(),您可以使用以下 基于 Locator Strategy :

  • 打印俄罗斯莫斯科:

    driver.get('https://mbasic.facebook.com/kristina.layus')
    print(WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.XPATH, "//span[text()='Current City']//following::td//a"))).text)
  • 注意:您必须添加以下导入:

    from selenium.webdriver.support.ui import WebDriverWait
    from selenium.webdriver.common.by import By
    from selenium.webdriver.support import expected_conditions as EC

引用资料

您可以在 NoSuchElementException 上找到一些相关讨论在:

关于python - 按字段名从表中提取数据。 Xpath, python ,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/63979940/

24 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com