python - 如何使用 python 通过 beautifulsoup 检索文本

Question

我想使用 beautifulsoup 从 HTML 中获取 Repairsonwheelsrim-hub.com 文本，请告诉我应该如何执行此操作。目前我正在使用

webadress = profilePageSource.select("span#offscreen a[href]")[0].get_text()


<div class="biz-website">
<span class="offscreen">Business website</span>
<a target="_blank" href="/biz_redir?url=http%3A%2F%2Frepairsonwheelsrim-hub.com&src_bizid=8tY2YtXPk1rGO7sl43LH8A&cachebuster=1438073532&s=6b75d47d32b28eb8e50506859857b75e949d698cdbc47e9892cc2a3b43e480c2">repairsonwheelsrim-hub.com</a>
</div>

Answer 1

这就是你想要的吗:

from bs4 import BeautifulSoup
text='<div class="biz-website"> <span class="offscreen">Business website</span> <a target="_blank" href="/biz_redir?url=http%3A%2F%2Frepairsonwheelsrim-hub.com&src_bizid=8tY2YtXPk1rGO7sl43LH8A&cachebuster=1438073532&s=6b75d47d32b28eb8e50506859857b75e949d698cdbc47e9892cc2a3b43e480c2">repairsonwheelsrim-hub.com</a> </div>'
soup = BeautifulSoup(text, 'html.parser')    
print soup.a.text

输出:

repairsonwheelsrim-hub.com

循环浏览 url 的文本:

from bs4 import BeautifulSoup
text='<div class="biz-website"> <span class="offscreen">Business website</span> <a target="_blank" href="/biz_redir?url=http%3A%2F%2Frepairsonwheelsrim-hub.com&src_bizid=8tY2YtXPk1rGO7sl43LH8A&cachebuster=1438073532&s=6b75d47d32b28eb8e50506859857b75e949d698cdbc47e9892cc2a3b43e480c2">repairsonwheelsrim-hub.com</a> </div>'    
soup = BeautifulSoup(text, 'html.parser')   
for t in soup.findAll("a"):
    print t.text

For more on BS4 see their official site

编辑:

# -*- coding: utf-8 -*-
from bs4 import BeautifulSoup
import requests
a=requests.get("http://www.yelp.com/biz/scotts-pizza-tours-new-york")
text=a.content

soup = BeautifulSoup(text, 'html.parser')   
for t in soup.findAll(lambda tag: tag.name == 'a' and 'target' in tag.attrs):
    if "".join(t["target"]) in "_blank":
        print t.get_text()

输出:

scottspizzatours.com
scottspizzatours.com
scottspizzatours.com/pri…