如何解决Python获取具有相同CSS类的html标签列表
我正在尝试解析HTML文档,并使用相似的CSS类将css_class_name的字典获取到标签列表中。
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN">
<html>
<head>
<title>My first styled page</title>
</head>
<body>
<!-- Site navigation menu -->
<ul class="navbar">
<li class="one"><a href="index.html">Home page</a>
<li class="one"><a href="musings.html">Musings</a>
<li class="two"><a href="town.html">My town</a>
<li class="two"><a href="links.html">Links</a>
</ul>
<!-- Main content -->
<div class = "three">
<h1>My first styled page</h1>
<p>Welcome to my styled page!
</div>
<div class = "four">
<p>It lacks images,but at least it has style.
And it has links,even if they don't go
anywhere…
</p>
</div>
<div class = "five">
<p>There should be more here,but I don't know
what yet.
</div>
<!-- Sign and date the page,it's only polite! -->
<address>Made 5 April 2004<br>
by myself.
</address>
</body>
</html>
我期望输出是如下所示的python字典:
{"one:[<li class="one"><a href="index.html">Home page</a>,<li class="one"><a href="musings.html">Musings</a>],"two":[
<li class="two"><a href="town.html">My town</a>,<li class="two"><a href="links.html">Links</a>],"three":[<div class = "three">
<h1>My first styled page</h1>
<p>Welcome to my styled page!
</div>],"four":[<div class = "four">
<p>It lacks images,even if they don't go
anywhere…
</p>
</div>],"five":[<div class = "five">
<p>There should be more here,but I don't know
what yet.
</div>]
]}
我试图探索漂亮的汤python包并探索API以得到如上所述的结果,但是找不到任何有助于获得所需结果的特定API /函数。在对标签进行分组之前,我需要了解CSS类,在这种情况下,以前是未知的。
解决方法
如果变量txt
包含您问题的HTML代码,则此脚本:
from bs4 import BeautifulSoup
soup = BeautifulSoup(txt,'lxml')
out = {}
for tag in soup.find_all(lambda t: 'class' in t.attrs):
for c in tag['class']:
out.setdefault(c,[]).append(tag)
# we don't want 'navbar' class:
del out['navbar']
from pprint import pprint
pprint(out)
打印:
{'five': [<div class="five">
<p>There should be more here,but I don't know
what yet.
</p></div>],'four': [<div class="four">
<p>It lacks images,but at least it has style.
And it has links,even if they don't go
anywhere…
</p>
</div>],'one': [<li class="one"><a href="index.html">Home page</a>
</li>,<li class="one"><a href="musings.html">Musings</a>
</li>],'three': [<div class="three">
<h1>My first styled page</h1>
<p>Welcome to my styled page!
</p></div>],'two': [<li class="two"><a href="town.html">My town</a>
</li>,<li class="two"><a href="links.html">Links</a>
</li>]}
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。