看代碼吧~
# -*- coding:utf-8 -*-
#python 2.7
#http://tieba.baidu.com/p/2460150866
#標(biāo)簽操作
from bs4 import BeautifulSoup
import urllib.request
import re
#如果是網(wǎng)址，可以用這個(gè)辦法來讀取網(wǎng)頁
#html_doc = "http://tieba.baidu.com/p/2460150866"
#req = urllib.request.Request(html_doc)
#webpage = urllib.request.urlopen(req)
#html = webpage.read()
html="""
html>head>title>The Dormouse's story/title>/head>
body>
p class="title" name="dromouse">b>The Dormouse's story/b>/p>
p class="story">Once upon a time there were three little sisters; and their names were
a rel="external nofollow" rel="external nofollow" class="sister" id="xiaodeng">!-- Elsie -->/a>,
a rel="external nofollow" rel="external nofollow" class="sister" id="link2">Lacie/a> and
a rel="external nofollow" class="sister" id="link3">Tillie/a>;
a rel="external nofollow" rel="external nofollow" class="sister" id="xiaodeng">Lacie/a>
and they lived at the bottom of a well./p>
p class="story">.../p>
"""
soup = BeautifulSoup(html, 'html.parser') #文檔對(duì)象
#查找a標(biāo)簽,只會(huì)查找出一個(gè)a標(biāo)簽
#print(soup.a)#a class="sister" rel="external nofollow" rel="external nofollow" id="xiaodeng">!-- Elsie -->/a>
for k in soup.find_all('a'):
print(k)
print(k['class'])#查a標(biāo)簽的class屬性
print(k['id'])#查a標(biāo)簽的id值
print(k['href'])#查a標(biāo)簽的href值
print(k.string)#查a標(biāo)簽的string
如果，標(biāo)簽a>中含有其他標(biāo)簽，比如em>../em>，此時(shí)要提取a>中的數(shù)據(jù)，需要用k.get_text()
soup = BeautifulSoup(html, 'html.parser') #文檔對(duì)象
#查找a標(biāo)簽,只會(huì)查找出一個(gè)a標(biāo)簽
for k in soup.find_all('a'):
print(k)
print(k['class'])#查a標(biāo)簽的class屬性
print(k['id'])#查a標(biāo)簽的id值
print(k['href'])#查a標(biāo)簽的href值
print(k.string)#查a標(biāo)簽的string
如果，標(biāo)簽a>中含有其他標(biāo)簽，比如em>../em>，此時(shí)要提取a>中的數(shù)據(jù)，需要用k.get_text()
通常我們使用下面這種模式也是能夠處理的，下面的方法使用了get()。
html = urlopen(url)
soup = BeautifulSoup(html, 'html.parser')
t1 = soup.find_all('a')
print t1
href_list = []
for t2 in t1:
t3 = t2.get('href')
href_list.append(t3)
補(bǔ)充：python爬蟲獲取任意頁面的標(biāo)簽和屬性（包括獲取a標(biāo)簽的href屬性）
看代碼吧~
# coding=utf-8
from bs4 import BeautifulSoup
import requests
# 定義一個(gè)獲取url頁面下label標(biāo)簽的attr屬性的函數(shù)
def getHtml(url, label, attr):
response = requests.get(url)
response.encoding = 'utf-8'
html = response.text
soup = BeautifulSoup(html, 'html.parser');
for target in soup.find_all(label):
try:
value = target.get(attr)
except:
value = ''
if value:
print(value)
url = 'https://baidu.com/'
label = 'a'
attr = 'href'
getHtml(url, label, attr)
以上為個(gè)人經(jīng)驗(yàn)，希望能給大家一個(gè)參考，也希望大家多多支持腳本之家。如有錯(cuò)誤或未考慮完全的地方，望不吝賜教。
您可能感興趣的文章:- python爬蟲之異常捕獲及標(biāo)簽過濾詳解
- Python深度學(xué)習(xí)之圖像標(biāo)簽標(biāo)注軟件labelme詳解
- python中Tkinter實(shí)現(xiàn)分頁標(biāo)簽的示例代碼
- Python 實(shí)現(xiàn)自動(dòng)完成A4標(biāo)簽排版打印功能
- Python氣泡提示與標(biāo)簽的實(shí)現(xiàn)
- Python 生成VOC格式的標(biāo)簽實(shí)例
- 基于python3生成標(biāo)簽云代碼解析
- python 實(shí)現(xiàn)添加標(biāo)簽&打標(biāo)簽的操作
