安装

1. selenium

pip install selenium

2. chrome driver

selenium已经不支持PhantomJS

UserWarning: Selenium support for PhantomJS has been deprecated, please use headless versions of Chrome or Firefox instead

推荐下载Chrome driver

codeing

简单测试

from selenium import webdriver
browser = webdriver.Chrome()
browser.get('http://i.ifeng.com')

不加载图片

prefs = {
  'profile.default_content_setting_values': {
    'images': 2
  }
}
options = webdriver.ChromeOptions()
options.add_experimental_option('prefs', prefs)

设置UA

#iPhone
options.add_argument('user-agent="Mozilla/5.0 (iPod; U; CPU iPhone OS 2_1 like Mac OS X; ja-jp) AppleWebKit/525.18.1 (KHTML, like Gecko) Version/3.1.1 Mobile/5F137 Safari/525.20"')
#华为荣耀V10
#options.add_argument('user-agent="Mozilla/5.0 (Linux; Android 9; BKL-AL20) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.90 Mobile Safari/537.36"')

设置代理

Options.add_argument('--proxy-server=http://ip:port')

设置窗口大小

browser.set_window_size(1920, 1080)

cookie

#获取cookie
#browser.get_cookies()
cookie=browser.get_cookie(name='region_ip')

#设置cookie
cookie['domain']='i.ifeng.com'
browser.add_cookie(cookie)

元素选取API

API文档

find_element_by_id
find_element_by_name
find_element_by_xpath
find_element_by_link_text
find_element_by_partial_link_text
find_element_by_tag_name
find_element_by_class_name
find_element_by_css_selector