scrapy crawl 运行后显示INFO: Spider closed (finished)

Question

2021-10-12 16:15:55 [scrapy.core.engine] INFO: Spider closed (finished)

robots协议，我已关闭

Answer 1

可以参考下这篇文章，希望对你有帮助：

scrapy爬虫错误一：无法爬到期望的数据_老油条666的博客-CSDN博客 最近在开始学习scrapy爬虫，遇到了一处很坑的地方，在屏幕上输出的debug信息总是没有任何结果就直接提示： [scrapy.statscollectors] INFO: Dumping Scrapy stats............................[scrapy.core.engine] INFO: Spider closed (finished)，然后程序就... https://blog.csdn.net/qq_15054345/article/details/86772372