python BeautifulSoup 在表中查找某些内容

Question

各位， 我已经成功地让 beautifulsoup 使用以下内容来抓取页面

html =  response.read()
soup = BeautifulSoup(html)
links = soup.findAll('a')

出现多次

<A href="javascript:Set_Variables('foo1','bar1''')"onmouseover="javascript: return window.status=''">
<A href="javascript:Set_Variables('foo2','bar2''')"onmouseover="javascript: return window.status=''">

如何迭代它并获取 foo/bar 值？

谢谢

Answer 1

您可以使用正则表达式从 href 属性中提取变量:

import re
from bs4 import BeautifulSoup

data = """
<div>
    <table>
        <A href="javascript:Set_Variables('foo1','bar1''')" onmouseover="javascript: return window.status=''">
        <A href="javascript:Set_Variables('foo2','bar2''')" onmouseover="javascript: return window.status=''">
    </table>
</div>
"""

soup = BeautifulSoup(data)

pattern = re.compile(r"javascript:Set_Variables\('(\w+)','(\w+)'")
for a in soup('a'):
    match = pattern.search(a['href'])
    if match:
        print match.groups()

打印:

('foo1', 'bar1')
('foo2', 'bar2')