scrapy shell 默认使用python 控制台，用起来还挺麻烦的，于是想用ipython进行替换，官网给出了两种方式

配置方式

1. 全局设置

通过配置环境变量的方式，添加SCRAPY_PYTHON_SHELL为ipython

image.png

2.局部设置

只在当前scrapy项目下使用ipython，需要修改scrapy.cfg配置文件，setting下添加一行

[settings]
shell = bpython

cd 到当前scrapy项目下即可使用ipython的shell

tab 补全时的debug提示干扰解决

使用ipython后会有以下情况，当使用tab进行补全时会出现干扰的debug信息

In [2]: res2022-06-29 10:36:57.804 | DEBUG    | parso.python.diff:update:282 - diff parser start
2022-06-29 10:36:57.806 | DEBUG    | parso.python.diff:update:293 - line_lengths old: 1; new: 1
2022-06-29 10:36:57.807 | DEBUG    | parso.python.diff:update:296 - -> code[replace] old[1:1] new[1:1]
2022-06-29 10:36:57.809 | DEBUG    | parso.python.diff:_parse:421 - parse_part from 1 to 1 (to 0 in part parser)
2022-06-29 10:36:57.810 | DEBUG    | parso.python.diff:update:339 - diff parser end

1.全局设置

1.1 F**K parso

pip uninstall parso

1.2 修改parso模块的debug设置

搜索当前python环境 Python38\Lib\site-packages\parso\python\diff.py

from parso.python.tokenize import PythonToken, BOM_UTF8_STRING
from parso.python.token import PythonTokenTypes

LOG = logging.getLogger(__name__)
DEBUG_DIFF_PARSER = False

# 以下为自行添加
logging.getLogger('parso.python.diff').disabled = True
logging.getLogger("parso.cache").disabled = True

2 shell启动配置

1. 提高日志级别，规避debug log

scrapy shell -L INFO https://example.com

2. shell中单独关闭对应的日志

__import__("logging").getLogger("parso.python.diff").disabled=True