我使用celery定时器执行任务，可启动时会出现这个错误
[2019-10-22 09:13:30,334: INFO/MainProcess] Connected to redis://127.0.0.1:6379/14
[2019-10-22 09:13:30,361: INFO/MainProcess] mingle: searching for neighbors
[2019-10-22 09:13:30,532: INFO/Beat] beat: Starting...
[2019-10-22 09:13:31,072: ERROR/Beat] Thread 'ResultHandler' crashed: ValueError('invalid file descriptor 13',)
Traceback (most recent call last):
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/pool.py", line 899, in body
for _ in self._process_result(1.0): # blocking
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/pool.py", line 864, in _process_result
ready, task = poll(timeout)
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/pool.py", line 1370, in _poll_result
if self._outqueue._reader.poll(timeout):
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 285, in poll
return self._poll(timeout)
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 463, in _poll
r = wait([self], timeout)
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 996, in wait
return _poll(object_list, timeout)
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 976, in _poll
raise ValueError('invalid file descriptor %i' % fd)
ValueError: invalid file descriptor 13
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/pool.py", line 504, in run
return self.body()
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/pool.py", line 904, in body
self.finish_at_shutdown()
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/pool.py", line 953, in finish_at_shutdown
if not outqueue._reader.poll():
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 285, in poll
return self._poll(timeout)
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 463, in _poll
r = wait([self], timeout)
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 991, in wait
return _poll(object_list, 0)
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 976, in _poll
raise ValueError('invalid file descriptor %i' % fd)
ValueError: invalid file descriptor 13
[2019-10-22 09:13:31,408: INFO/MainProcess] mingle: all alone
[2019-10-22 09:13:31,423: INFO/MainProcess] celery@iZwz9h41nalpsqzz57x4tmZ ready.
重启几次这个错误就不会出现，但运行一段时间后再次从定时器发布任务时还会出现该错误导致任务执行失败
[2019-10-22 07:00:00,000: INFO/Beat] Scheduler: Sending due task monitoring_auto_run (run.monitoring_auto_run)
[2019-10-22 07:00:00,008: INFO/MainProcess] Received task: run.monitoring_auto_run[469ee195-3e1a-4bf0-a7cb-783232e8d0bc]
[2019-10-22 07:00:00,105: ERROR/ForkPoolWorker-11] Thread 'ResultHandler' crashed: ValueError('invalid file descriptor 14',)
Traceback (most recent call last):
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/pool.py", line 504, in run
return self.body()
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/pool.py", line 899, in body
for _ in self._process_result(1.0): # blocking
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/pool.py", line 864, in _process_result
ready, task = poll(timeout)
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/pool.py", line 1370, in _poll_result
if self._outqueue._reader.poll(timeout):
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 285, in poll
return self._poll(timeout)
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 463, in _poll
r = wait([self], timeout)
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 996, in wait
return _poll(object_list, timeout)
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/connection.py", line 976, in _poll
raise ValueError('invalid file descriptor %i' % fd)
ValueError: invalid file descriptor 14
[2019-10-22 07:00:00,768: ERROR/MainProcess] Process 'ForkPoolWorker-11' pid:15068 exited with 'exitcode 1'
[2019-10-22 07:00:11,186: ERROR/MainProcess] Task handler raised error: WorkerLostError('Worker exited prematurely: exitcode 1.',)
Traceback (most recent call last):
File "/pyenvs/spider/lib64/python3.6/site-packages/billiard/pool.py", line 1267, in mark_as_worker_lost
human_status(exitcode)),
billiard.exceptions.WorkerLostError: Worker exited prematurely: exitcode 1.
