我用自己的ip地址还是有问题,我把中间件去掉可以正常爬取
import random
class SpiderMiddleware(object):
def process_request(self,request,spider):
proxy =[
'223.104.21.84',
'123.123.54.43:8060',
'125.120.0.43:8060',
'114.228.108.13:8060'
]
ip = random.choice(proxy)
print(ip)
request.meta['proxy'] = 'http://' + ip
```![图片说明](https://img-ask.csdn.net/upload/201908/12/1565604721_140653.png)