urllib2 第一篇
资源访问:urlopen()
数据读取:read()
urlopen()-->response
-->response-->read()抓取网页数据
-->response-->info()抓去网页请求报头信息
-->response-->geturl()抓取访问地址
-->response-->getcode()抓取访问错误代码
import urllib2
req = urllib2.Request('https://www.baidu.com')
response = urllib2.urlopen(req)
pg = response.read()
print (pg)
运行结果:
urllib2 第二篇
伪造浏览器请求
请求对象Request
-->Reauest-->add_header(key,value):设置请求头数据
-->Reauest-->add_header(key):根据名称获取请求头数据
# -*- coding:utf-8 -*-
import urllib2
from urllib2 import Request
#伪造浏览器
Headers={"User-Agent":"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.101 Safari/537.36"}
req = Request('https://www.baidu.com',headers=Headers)
response = urllib2.urlopen(req)
pg = response.read()
print (pg)
运行结果: