scrapy新手：Scrapy报错 报错如下 请问是什么问题导致的

Question

请问这个问题是怎么回事？网上昨天搜了一天也没找到答案。

[scrapy] ERROR: Spider error processing (referer: None)
Traceback (most recent call last):
File "F:\PythonPacket\lib\site-packages\scrapy\utils\defer.py", line 102, in iter_errback
yield next(it)
File "F:\PythonPacket\lib\site-packages\scrapy\spidermiddlewares\offsite.py", line 29, in process_spider_output
for x in result:
File "F:\PythonPacket\lib\site-packages\scrapy\spidermiddlewares\referer.py", line 22, in
return (_set_referer(r) for r in result or ())
File "F:\PythonPacket\lib\site-packages\scrapy\spidermiddlewares\urllength.py", line 37, in
return (r for r in result or () if _filter(r))
File "F:\PythonPacket\lib\site-packages\scrapy\spidermiddlewares\depth.py", line 58, in
return (r for r in result or () if _filter(r))
File "F:\doubanbook\doubanbook\spiders\dbbook.py", line 22, in parse
author = re.search('

(.*?)<br',each.extract(),re.S).group(1)
File "F:\PythonPacket\lib\site-packages\parsel\selector.py", line 251, in extract
with_tail=False)
File "lxml.etree.pyx", line 2624, in lxml.etree.tostring (src/lxml/lxml.etree.c:49461)
File "serializer.pxi", line 105, in lxml.etree._tostring (src/lxml/lxml.etree.c:79144)
LookupError: unknown encoding: 'unicode'

Answer 1

LookupError: unknown encoding: 'unicode'

数据处理编码的问题，看看你处理的数据是否正确编解码