lowry_lkr 2013-12-05 12:51 采纳率: 100%
浏览 2915
已采纳

mapreduce 运行时候出现的错误,ZipException

用tomcat跑一个web工程,用mapreduce从mysql导入数据时遇到如下问题,求解:

13/12/05 20:39:35 INFO mapred.JobClient: Running job: job_201311251041_0681
13/12/05 20:39:36 INFO mapred.JobClient: map 0% reduce 0%
13/12/05 20:39:40 INFO mapred.JobClient: Task Id : attempt_201311251041_0681_m_000003_0, Status : FAILED
Error initializing attempt_201311251041_0681_m_000003_0:
java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:114)
at java.util.jar.JarFile.(JarFile.java:133)
at java.util.jar.JarFile.(JarFile.java:97)
at org.apache.hadoop.util.RunJar.unJar(RunJar.java:36)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:815)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)

13/12/05 20:39:40 WARN mapred.JobClient: Error reading task outputhttp://dell4:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_m_000003_0&filter=stdout
13/12/05 20:39:40 WARN mapred.JobClient: Error reading task outputhttp://dell4:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_m_000003_0&filter=stderr

13/12/05 20:39:43 INFO mapred.JobClient: Task Id : attempt_201311251041_0681_r_000002_0, Status : FAILED
Error initializing attempt_201311251041_0681_r_000002_0:
java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:114)
at java.util.jar.JarFile.(JarFile.java:133)
at java.util.jar.JarFile.(JarFile.java:97)
at org.apache.hadoop.util.RunJar.unJar(RunJar.java:36)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:815)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)

13/12/05 20:39:43 WARN mapred.JobClient: Error reading task outputhttp://dell4:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_r_000002_0&filter=stdout
13/12/05 20:39:43 WARN mapred.JobClient: Error reading task outputhttp://dell4:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_r_000002_0&filter=stderr
13/12/05 20:39:46 INFO mapred.JobClient: Task Id : attempt_201311251041_0681_m_000003_1, Status : FAILED
Error initializing attempt_201311251041_0681_m_000003_1:
java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:114)
at java.util.jar.JarFile.(JarFile.java:133)
at java.util.jar.JarFile.(JarFile.java:97)
at org.apache.hadoop.util.RunJar.unJar(RunJar.java:36)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:815)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)

13/12/05 20:39:46 WARN mapred.JobClient: Error reading task outputhttp://dell1:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_m_000003_1&filter=stdout
13/12/05 20:39:46 WARN mapred.JobClient: Error reading task outputhttp://dell1:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_m_000003_1&filter=stderr
13/12/05 20:39:49 INFO mapred.JobClient: Task Id : attempt_201311251041_0681_r_000002_1, Status : FAILED
Error initializing attempt_201311251041_0681_r_000002_1:
java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:114)
at java.util.jar.JarFile.(JarFile.java:133)
at java.util.jar.JarFile.(JarFile.java:97)
at org.apache.hadoop.util.RunJar.unJar(RunJar.java:36)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:815)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)

13/12/05 20:39:49 WARN mapred.JobClient: Error reading task outputhttp://dell1:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_r_000002_1&filter=stdout
13/12/05 20:39:49 WARN mapred.JobClient: Error reading task outputhttp://dell1:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_r_000002_1&filter=stderr
13/12/05 20:39:52 INFO mapred.JobClient: Task Id : attempt_201311251041_0681_m_000003_2, Status : FAILED
Error initializing attempt_201311251041_0681_m_000003_2:
java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:114)
at java.util.jar.JarFile.(JarFile.java:133)
at java.util.jar.JarFile.(JarFile.java:97)
at org.apache.hadoop.util.RunJar.unJar(RunJar.java:36)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:815)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)

13/12/05 20:39:52 WARN mapred.JobClient: Error reading task outputhttp://dell2:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_m_000003_2&filter=stdout
13/12/05 20:39:52 WARN mapred.JobClient: Error reading task outputhttp://dell2:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_m_000003_2&filter=stderr
13/12/05 20:39:58 INFO mapred.JobClient: Task Id : attempt_201311251041_0681_m_000002_0, Status : FAILED
Error initializing attempt_201311251041_0681_m_000002_0:
java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:114)
at java.util.jar.JarFile.(JarFile.java:133)
at java.util.jar.JarFile.(JarFile.java:97)
at org.apache.hadoop.util.RunJar.unJar(RunJar.java:36)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:815)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)

13/12/05 20:39:58 WARN mapred.JobClient: Error reading task outputhttp://dell2:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_m_000002_0&filter=stdout
13/12/05 20:39:58 WARN mapred.JobClient: Error reading task outputhttp://dell2:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_m_000002_0&filter=stderr
13/12/05 20:40:01 INFO mapred.JobClient: Task Id : attempt_201311251041_0681_r_000001_0, Status : FAILED
Error initializing attempt_201311251041_0681_r_000001_0:
java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:114)
at java.util.jar.JarFile.(JarFile.java:133)
at java.util.jar.JarFile.(JarFile.java:97)
at org.apache.hadoop.util.RunJar.unJar(RunJar.java:36)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:815)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)

13/12/05 20:40:01 WARN mapred.JobClient: Error reading task outputhttp://dell2:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_r_000001_0&filter=stdout
13/12/05 20:40:01 WARN mapred.JobClient: Error reading task outputhttp://dell2:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_r_000001_0&filter=stderr
13/12/05 20:40:07 INFO mapred.JobClient: Task Id : attempt_201311251041_0681_m_000002_1, Status : FAILED
Error initializing attempt_201311251041_0681_m_000002_1:
java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:114)
at java.util.jar.JarFile.(JarFile.java:133)
at java.util.jar.JarFile.(JarFile.java:97)
at org.apache.hadoop.util.RunJar.unJar(RunJar.java:36)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:815)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)

13/12/05 20:40:07 WARN mapred.JobClient: Error reading task outputhttp://dell4:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_m_000002_1&filter=stdout
13/12/05 20:40:07 WARN mapred.JobClient: Error reading task outputhttp://dell4:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_m_000002_1&filter=stderr
13/12/05 20:40:10 INFO mapred.JobClient: Task Id : attempt_201311251041_0681_r_000001_1, Status : FAILED
Error initializing attempt_201311251041_0681_r_000001_1:
java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:114)
at java.util.jar.JarFile.(JarFile.java:133)
at java.util.jar.JarFile.(JarFile.java:97)
at org.apache.hadoop.util.RunJar.unJar(RunJar.java:36)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:815)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)

13/12/05 20:40:10 WARN mapred.JobClient: Error reading task outputhttp://dell4:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_r_000001_1&filter=stdout
13/12/05 20:40:10 WARN mapred.JobClient: Error reading task outputhttp://dell4:50060/tasklog?plaintext=true&taskid=attempt_201311251041_0681_r_000001_1&filter=stderr

我是调用hadoop中对数据库操作的库,实现把某一个表从mysql数据库并行导入hdfs,我单独写一个java程序可以成功导入,但是放到web工程里边,mapreduce就会出现这个ZipException问题

  • 写回答

1条回答

  • qq2867234 2013-12-18 17:39
    关注

    我也遇到这个问题,应该是web工程启动hadoop的job时出了问题,因为java工程启动的时候可以选择run on hadoop,但是到了web就不受我们控制了,可能是成了run on Application,才出现这些问题。。现在还不知道该怎么解决,解决了吗?可以加我qq交流一下吗。(270104832)

    本回答被题主选为最佳回答 , 对您是否有帮助呢?
    评论

报告相同问题?

悬赏问题

  • ¥15 求差集那个函数有问题,有无佬可以解决
  • ¥15 【提问】基于Invest的水源涵养
  • ¥20 微信网友居然可以通过vx号找到我绑的手机号
  • ¥15 寻一个支付宝扫码远程授权登录的软件助手app
  • ¥15 解riccati方程组
  • ¥15 display:none;样式在嵌套结构中的已设置了display样式的元素上不起作用?
  • ¥15 使用rabbitMQ 消息队列作为url源进行多线程爬取时,总有几个url没有处理的问题。
  • ¥15 Ubuntu在安装序列比对软件STAR时出现报错如何解决
  • ¥50 树莓派安卓APK系统签名
  • ¥65 汇编语言除法溢出问题