背景

• python 3.8
• 网站：51job

问题展示

curl 'https://search.51job.com/list/000000,000000,0000,00,9,99,%25E9%2581%2593%25E6%2599%25AE,2,1.html?lang=c&postchannel=0000&workyear=99&cotype=99&degreefrom=99&jobterm=99&companysize=99&ord_field=0&dibiaoid=0&line=&welfare=' \
  -H 'Connection: keep-alive' \
  -H 'sec-ch-ua: "Chromium";v="94", "Google Chrome";v="94", ";Not A Brand";v="99"' \
  -H 'Accept: application/json, text/javascript, */*; q=0.01' \
  -H 'X-Requested-With: XMLHttpRequest' \
  -H 'sec-ch-ua-mobile: ?0' \
  -H 'User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.81 Safari/537.36' \
  -H 'sec-ch-ua-platform: "Windows"' \
  -H 'Sec-Fetch-Site: same-origin' \
  -H 'Sec-Fetch-Mode: cors' \
  -H 'Sec-Fetch-Dest: empty' \
  -H 'Referer: https://search.51job.com/list/000000,000000,0000,00,9,99,%25E9%2581%2593%25E6%2599%25AE,2,1.html?lang=c&postchannel=0000&workyear=99&cotype=99&degreefrom=99&jobterm=99&companysize=99&ord_field=0&dibiaoid=0&line=&welfare=' \
  -H 'Accept-Language: zh-CN,zh;q=0.9' \
  -H 'Cookie: _uab_collina=164127837153413229653829; guid=dbd67b84bdac10c9b99c3d23ebc5bd2e; slife=lowbrowser%3Dnot%26%7C%26; privacy=1641278463; nsearch=jobarea%3D%26%7C%26ord_field%3D%26%7C%26recentSearch0%3D%26%7C%26recentSearch1%3D%26%7C%26recentSearch2%3D%26%7C%26recentSearch3%3D%26%7C%26recentSearch4%3D%26%7C%26collapse_expansion%3D; search=jobarea%7E%60000000%7C%21ord_field%7E%600%7C%21recentSearch0%7E%60000000%A1%FB%A1%FA000000%A1%FB%A1%FA0000%A1%FB%A1%FA00%A1%FB%A1%FA99%A1%FB%A1%FA%A1%FB%A1%FA99%A1%FB%A1%FA99%A1%FB%A1%FA99%A1%FB%A1%FA99%A1%FB%A1%FA9%A1%FB%A1%FA99%A1%FB%A1%FA%A1%FB%A1%FA0%A1%FB%A1%FA%B5%C0%C6%D5%A1%FB%A1%FA2%A1%FB%A1%FA1%7C%21; acw_tc=2f624a3016412804013691261e356ced4b32f5b0d6880bb2feeaa0f94cd924; acw_sc__v2=61d3f3fd9f8bdc091dbc426ffdd48a825ed04492; acw_sc__v2=61d3f3fd9f8bdc091dbc426ffdd48a825ed04492; ssxmod_itna=7q0O5fxRhxXD8D2n+qoiK4DKWmlDIrLxl8G4GXYmKDZDiqAPGhDCfo/OLgbM4rqxDyG4YY33SE3AKaokfDe2Iw7xB3DEx06bWUnDiicDCeDIDWeDiDG4Gmn4GtDpxG=Djm/ZCSLxYPGWbqGfDDoDY362DitD4qDBzxdDKqGgbkDrbuijWWtohqeqwY+nD0t3xBdeiawnCQcacDNqq1n7UiYDCEvCwiq=R1Y4DgNWKqGytKGuATUlnbRCOTXS/wv5ig+587mQ8DxaD2qPziqijD+rdrYd/p5iiDHdUix3G0z=DD3svBdheD==; ssxmod_itna2=7q0O5fxRhxXD8D2n+qoiK4DKWmlDIrLxl8DA6u0xD/zDUg47pQ+HOp654FGFWmPob0H/IxQb2zuzinAjIa7ErKYvW53PLuhubRRfaEqXZpSDvZ3w6cNAEw7PZyzArejZZMnk3FEcR/TIZ8TUn83isK+isjRdxubifDxmE43AYS0RhDOG+K+f5nltfUDx=7hDOSo+A/lKFvLP71ZEpYSh9iLvIBEUav2yO7aKsx6BvA3Imr/FfeIIIXd7siu3sMLgA8K6zZO8CWCYeZgK2ipcbpE=aE/HykXOGlU5aw4ZBKC1PrQCFaaa3g4rg8/DYA27yusyx=3x=DxkLTkxgO/ia4EOpOY3iCxhCjbQWTxyAowjYWObjDx0f4irp=oFYkpL3oYqKne+UG3j8YlGbnjvjB404h41YZAGr775oaRiOG2Ehu3NZ7OS4i6+TcIrp5uYLHRvCaAGPLYLdI=fbrLl7dwo6+8TRBTr1GwZOvDDwPx=mLhR+ZUteeK/+P/tDV+2xYBfi7NzxDjKDeqa4rxNGqVZPqiq3132xxNBXeGDCWqGGxlYoriDD===' \
  --compressed

• %25E9%2581%2593%25E6%2599%25AE看不懂这是个啥
• 有点像URL编码
• URL解码后 %E9%81%93%E6%99%AE
• 这到底是什么编码呢？

过程

• 各种查找后，URL二次编码
• 工具网站 https://www.bejson.com/

1. 解码： %25E9%2581%2593%25E6%2599%25A
2. 结果 ：%E9%81%93%E6%99%A
3. 解码 ：%E9%81%93%E6%99%A
4. 结果：道普

总结

• URL二次编码