psutil是一个跨平台库(http://pythonhosted.org/psutil/[http://pythonhosted.org/ps...

thread_num=100 cat $1| xargs -n 1 -I {} -P ${thread_num} sh url_crawler....