529656407 2015-03-15 10:05 采纳率: 80%
浏览 3997

webcollector 爬虫报错

com.sleepycat.je.EnvironmentFailureException: (JE 5.0.73) Environment must be closed, caused by: com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 5.0.73) crawl com.sleepycat.je.log.ChecksumException: Location 0x95e/0x4e64e9 expected 3765141285 got 1824161637 LOG_CHECKSUM: Checksum invalid on read, log is likely invalid. Environment is invalid and must be closed.
at com.sleepycat.je.EnvironmentFailureException.wrapSelf(EnvironmentFailureException.java:196)
at com.sleepycat.je.dbi.EnvironmentImpl.checkIfInvalid(EnvironmentImpl.java:1512)
at com.sleepycat.je.dbi.CursorImpl.checkEnv(CursorImpl.java:2838)
at com.sleepycat.je.Cursor.checkEnv(Cursor.java:4048)
at com.sleepycat.je.Cursor.close(Cursor.java:515)
at com.sleepycat.je.Database.putInternal(Database.java:1306)
at com.sleepycat.je.Database.put(Database.java:1172)
at cn.edu.hfut.dmic.webcollector.fetcher.DbUpdater.merge(DbUpdater.java:105)
at cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.before(Fetcher.java:352)
at cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll(Fetcher.java:376)
at cn.edu.hfut.dmic.webcollector.crawler.Crawler.start(Crawler.java:128)
at MainOracle.main(MainOracle.java:202)
Caused by: com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 5.0.73) crawl com.sleepycat.je.log.ChecksumException: Location 0x95e/0x4e64e9 expected 3765141285 got 1824161637 LOG_CHECKSUM: Checksum invalid on read, log is likely invalid. Environment is invalid and must be closed.
at com.sleepycat.je.cleaner.FileProcessor.processFile(FileProcessor.java:735)
at com.sleepycat.je.cleaner.FileProcessor.doClean(FileProcessor.java:289)
at com.sleepycat.je.cleaner.FileProcessor.onWakeup(FileProcessor.java:148)
at com.sleepycat.je.utilint.DaemonThread.run(DaemonThread.java:163)
at java.lang.Thread.run(Thread.java:662)
Caused by: com.sleepycat.je.log.ChecksumException: Location 0x95e/0x4e64e9 expected 3765141285 got 1824161637
at com.sleepycat.je.log.ChecksumValidator.validate(ChecksumValidator.java:77)
at com.sleepycat.je.log.FileReader.validateChecksum(FileReader.java:679)
at com.sleepycat.je.log.FileReader.readNextEntryAllowExceptions(FileReader.java:329)
at com.sleepycat.je.cleaner.FileProcessor.processFile(FileProcessor.java:504)
... 4 more
Exception in thread "main" com.sleepycat.je.EnvironmentFailureException: (JE 5.0.73) Environment must be closed, caused by: com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 5.0.73) crawl com.sleepycat.je.log.ChecksumException: Location 0x95e/0x4e64e9 expected 3765141285 got 1824161637 LOG_CHECKSUM: Checksum invalid on read, log is likely invalid. Environment is invalid and must be closed.
at com.sleepycat.je.EnvironmentFailureException.wrapSelf(EnvironmentFailureException.java:196)
at com.sleepycat.je.dbi.EnvironmentImpl.checkIfInvalid(EnvironmentImpl.java:1512)
at com.sleepycat.je.Environment.checkEnv(Environment.java:2185)
at com.sleepycat.je.Environment.openDatabase(Environment.java:599)
at cn.edu.hfut.dmic.webcollector.fetcher.DbUpdater.lock(DbUpdater.java:57)
at cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.before(Fetcher.java:360)
at cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll(Fetcher.java:376)
at cn.edu.hfut.dmic.webcollector.crawler.Crawler.start(Crawler.java:128)
at MainOracle.main(MainOracle.java:202)
Caused by: com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 5.0.73) crawl com.sleepycat.je.log.ChecksumException: Location 0x95e/0x4e64e9 expected 3765141285 got 1824161637 LOG_CHECKSUM: Checksum invalid on read, log is likely invalid. Environment is invalid and must be closed.
at com.sleepycat.je.cleaner.FileProcessor.processFile(FileProcessor.java:735)
at com.sleepycat.je.cleaner.FileProcessor.doClean(FileProcessor.java:289)
at com.sleepycat.je.cleaner.FileProcessor.onWakeup(FileProcessor.java:148)
at com.sleepycat.je.utilint.DaemonThread.run(DaemonThread.java:163)
at java.lang.Thread.run(Thread.java:662)
Caused by: com.sleepycat.je.log.ChecksumException: Location 0x95e/0x4e64e9 expected 3765141285 got 1824161637
at com.sleepycat.je.log.ChecksumValidator.validate(ChecksumValidator.java:77)
at com.sleepycat.je.log.FileReader.validateChecksum(FileReader.java:679)
at com.sleepycat.je.log.FileReader.readNextEntryAllowExceptions(FileReader.java:329)
at com.sleepycat.je.cleaner.FileProcessor.processFile(FileProcessor.java:504)
... 4 more
2015-3-15 18:01:20 com.sleepycat.je.utilint.DaemonThread run
严重: caught exception, com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 5.0.73) crawl com.sleepycat.je.log.ChecksumException: Location 0x95e/0x4e64e9 expected 3765141285 got 1824161637 LOG_CHECKSUM: Checksum invalid on read, log is likely invalid. Environment is invalid and must be closed. Exiting
com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 5.0.73) crawl com.sleepycat.je.log.ChecksumException: Location 0x95e/0x4e64e9 expected 3765141285 got 1824161637 LOG_CHECKSUM: Checksum invalid on read, log is likely invalid. Environment is invalid and must be closed.
at com.sleepycat.je.cleaner.FileProcessor.processFile(FileProcessor.java:735)
at com.sleepycat.je.cleaner.FileProcessor.doClean(FileProcessor.java:289)
at com.sleepycat.je.cleaner.FileProcessor.onWakeup(FileProcessor.java:148)
at com.sleepycat.je.utilint.DaemonThread.run(DaemonThread.java:163)
at java.lang.Thread.run(Thread.java:662)
Caused by: com.sleepycat.je.log.ChecksumException: Location 0x95e/0x4e64e9 expected 3765141285 got 1824161637
at com.sleepycat.je.log.ChecksumValidator.validate(ChecksumValidator.java:77)
at com.sleepycat.je.log.FileReader.validateChecksum(FileReader.java:679)
at com.sleepycat.je.log.FileReader.readNextEntryAllowExceptions(FileReader.java:329)
at com.sleepycat.je.cleaner.FileProcessor.processFile(FileProcessor.java:504)
... 4 more

  • 写回答

2条回答 默认 最新

  • 529656407 2015-03-16 15:47
    关注

    没人吗。。。。。。。。。。。。。。。。

    评论

报告相同问题？

  • scrapy模块进行爬虫报错 python 爬虫
    2022-12-27 23:14
    回答 1 已采纳 望采纳！点击该回答右侧的“采纳”按钮即可采纳！！！我猜测可能是因为没有在你的项目目录下创建这个模块，或者是你在项目的 settings.py 文件中没有指定正确的模块路径。你需要确保在你的项目目录下有
  • 爬虫报错ndcoding python 爬虫
    2022-01-26 23:28
    回答 2 已采纳 字母拼错啦！是encoding🙈记得采纳支持一下哦🙊🙊🙊
  • 请教爬虫报错Nginx forbidden nginx python 有问必答 爬虫
    2021-11-17 00:00
    回答 3 已采纳 一是网址写错了，将鼠标放到新房链接图片上就可以看到正确链接，即：http://www.tmsf.com/hzweb/newhouse/二是在请求头里要添加cookie。
  • WebCollector 爬虫
    2018-10-15 16:01
    爬虫webcollector 框架，所有jar包。
  • python爬虫报错 python 有问必答
    2022-04-02 00:07
    回答 7 已采纳 user_agent = 'Mozilla/5.0 (Windows NT 10.0; Win64; x64)' # 使用请求头进行伪装 self.headers={'User-Agent': use
  • 爬虫json报错解决方法 python 爬虫
    2022-12-09 10:07
    回答 1 已采纳 worldDataStr不是标准的json格式，所以用json.loads 会报错
  • python爬虫报错，jsonp python 有问必答
    2021-06-25 09:46
    回答 3 已采纳 参数callback去掉 import requests import json headers = {'Host': 'xyq.cbg.163.com', 'Refere
  • python 爬虫 报错 求救
    2020-12-22 02:37
    raise JSONDecodeError(“Expecting value”, s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)报错! 在找到某度文库文档的js文件链接后想用json.loads()进行解析...
  • 爬虫报错：Message: no such element: Unable to locate element python 有问必答 爬虫
    2023-04-16 11:14
    回答 2 已采纳 find_element最好是改成find_elements，不同用户访问生成的dom结构不一样，需要判断是否获取到，获取到再获取text属性。我这里显示的结构和题注就不一样 用样式来定位试试，我这里
  • 爬虫报错，headers也加了为啥还报错呀？ python 爬虫
    2021-11-14 12:27
    回答 2 已采纳 观察了一下此网站，是他的地理位置那一栏的标签顺序有变化，所以find未找到对应的值，导致解析失败无数据，建议换一种解析库，代码如下： import time import requests from
  • Python爬虫配合VPN爬取出现报错 python 爬虫
    2021-12-22 17:33
    回答 1 已采纳 你这个是VPN代理问题，你可以将VPN设置成部分代理，不要全部代理你的网络。
  • WebCollector:WebCollector爬虫框架原始码
    2021-03-23 16:55
    #WebCollector WebCollector爬虫框架原始码WebCollector是基于Java的开源Web爬网程序框架。它提供了一些用于爬网的简单界面，您可以在不到5分钟的时间内设置多线程Web爬网程序。 ## Homehttps ## Document ＃＃安装...
  • selenium爬虫报错，请各位大大帮我看下是哪里问题 python 爬虫
    2021-12-15 22:43
    回答 1 已采纳 get_product()函数里的xpath语法全都有问题啊1、//*后面不能有div了，直接接属性及属性值了2、说实话你第一句//*div[@class="items"]/div[@class="i
  • Selenium爬虫报错
    2023-06-28 11:04
    小马布失棉的博客 Error分析：使用selenium打开浏览器部分报错，显示chromedriver驱动需要在路径下，即需要对驱动做操作。代码功能：第一次使用selenium模仿浏览器操作，爬取Boss直聘的招聘信息（requests容易被反爬虫）2. 下载edge...
  • 爬虫系统 Python实现 后端
    2023-08-19 14:44
    我开发了一个强大的Python后端爬虫系统，该系统具备以下主要功能： 网易新闻爬取：系统可以自动爬取网易新闻上的新闻内容，并将其保存到数据库中。用户可以通过系统提供的接口或界面，快速获取最新的新闻信息。 ...
  • 没有解决我的问题, 去提问

悬赏问题

  • ¥15 #MATLAB仿真#车辆换道路径规划
  • ¥15 java 操作 elasticsearch 8.1 实现 索引的重建
  • ¥15 数据可视化Python
  • ¥15 要给毕业设计添加扫码登录的功能！！有偿
  • ¥15 kafka 分区副本增加会导致消息丢失或者不可用吗？
  • ¥15 微信公众号自制会员卡没有收款渠道啊
  • ¥100 Jenkins自动化部署—悬赏100元
  • ¥15 关于#python#的问题：求帮写python代码
  • ¥20 MATLAB画图图形出现上下震荡的线条
  • ¥15 关于#windows#的问题：怎么用WIN 11系统的电脑 克隆WIN NT3.51-4.0系统的硬盘