使用requests模拟登录
以登录http://blog.csdn.net为例,第一种方法是使用浏览器手动登录,然后利用firebug或其他浏览器的开发者工具获取cookie,如图:

图片.png
源代码如下:
# coding=utf8
import requests
url = 'https://my.csdn.net/my/follow'
cookie_str = r'这一大段cookie字符串'
cookies = {}
for line in cookie_str.split(';'):
key, value = line.split('=', 1)
cookies[key] = value
# 设置请求头
headers = {'User-agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) '
'Chrome/60.0.3112.113 Safari/537.36'}
response = requests.get(url, headers=headers, cookies=cookies)
with open('csdn_blog_requests.html', 'w') as f:
f.write(response.content)