pproxy代理工具

HTTP Proxy to Socks5

• 安装python-proxy

  pip3 install pproxy
  

• 运行

  pproxy
  

  or

  pproxy -l http://:808 -r socks5://127.0.0.1:16778 -vv
  

在scrapy中使用pproxy

• Scrapy with HTTP Proxy Create middleware (middlewares.py)

  class ProxyMiddleware(object):
      def process_request(self, request, spider):
          request.meta['proxy'] = "http://127.0.0.1:8181"
  

• Assign it to DOWNLOADER_MIDDLEWARES (settings.py)

  DOWNLOADER_MIDDLEWARES = {
      '<PROJECT_NAME_HERE>.middlewares.ProxyMiddleware': 350
  }