yezhirm7 2017-06-13 07:37 采纳率: 0%
浏览 2864

map 和 reduce0%就失败了,能帮我看看是什么原因吗?

17/06/13 15:30:29 INFO client.RMProxy: Connecting to ResourceManager at master/192.168.1.100:8032
17/06/13 15:30:29 INFO input.FileInputFormat: Total input paths to process : 1
17/06/13 15:30:29 INFO mapreduce.JobSubmitter: number of splits:1
17/06/13 15:30:30 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1497335254625_0003
17/06/13 15:30:30 INFO impl.YarnClientImpl: Submitted application application_1497335254625_0003
17/06/13 15:30:30 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1497335254625_0003/
17/06/13 15:30:30 INFO mapreduce.Job: Running job: job_1497335254625_0003
17/06/13 15:30:34 INFO mapreduce.Job: Job job_1497335254625_0003 running in uber mode : false
17/06/13 15:30:34 INFO mapreduce.Job: map 0% reduce 0%
17/06/13 15:30:39 INFO mapreduce.Job: Task Id : attempt_1497335254625_0003_m_000000_0, Status : FAILED
Exception from container-launch.
Container id: container_1497335254625_0003_01_000002
Exit code: 1
Exception message: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData /nm-local-dir/usercache/hadoop/appcache/application_1497335254625_0003/container_1497335254625_0003_01_000002/default_container_executor_session.sh: 行 3: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData: 是一个目录
/bin/mv: 目标"/nm-local-dir/nmPrivate/application_1497335254625_0003/container_1497335254625_0003_01_000002/container_1497335254625_0003_01_000002.pid" 不是目录

Stack trace: ExitCodeException exitCode=1: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData /nm-local-dir/usercache/hadoop/appcache/application_1497335254625_0003/container_1497335254625_0003_01_000002/default_container_executor_session.sh: 行 3: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData: 是一个目录
/bin/mv: 目标"/nm-local-dir/nmPrivate/application_1497335254625_0003/container_1497335254625_0003_01_000002/container_1497335254625_0003_01_000002.pid" 不是目录

at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

Container exited with a non-zero exit code 1

17/06/13 15:30:45 INFO mapreduce.Job: Task Id : attempt_1497335254625_0003_m_000000_1, Status : FAILED
Exception from container-launch.
Container id: container_1497335254625_0003_01_000003
Exit code: 1
Exception message: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData /nm-local-dir/usercache/hadoop/appcache/application_1497335254625_0003/container_1497335254625_0003_01_000003/default_container_executor_session.sh: 行 3: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData: 是一个目录
/bin/mv: 目标"/nm-local-dir/nmPrivate/application_1497335254625_0003/container_1497335254625_0003_01_000003/container_1497335254625_0003_01_000003.pid" 不是目录

Stack trace: ExitCodeException exitCode=1: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData /nm-local-dir/usercache/hadoop/appcache/application_1497335254625_0003/container_1497335254625_0003_01_000003/default_container_executor_session.sh: 行 3: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData: 是一个目录
/bin/mv: 目标"/nm-local-dir/nmPrivate/application_1497335254625_0003/container_1497335254625_0003_01_000003/container_1497335254625_0003_01_000003.pid" 不是目录

at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

Container exited with a non-zero exit code 1

17/06/13 15:30:51 INFO mapreduce.Job: Task Id : attempt_1497335254625_0003_m_000000_2, Status : FAILED
Exception from container-launch.
Container id: container_1497335254625_0003_01_000004
Exit code: 1
Exception message: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData /nm-local-dir/usercache/hadoop/appcache/application_1497335254625_0003/container_1497335254625_0003_01_000004/default_container_executor_session.sh: 行 3: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData: 是一个目录
/bin/mv: 目标"/nm-local-dir/nmPrivate/application_1497335254625_0003/container_1497335254625_0003_01_000004/container_1497335254625_0003_01_000004.pid" 不是目录

Stack trace: ExitCodeException exitCode=1: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData /nm-local-dir/usercache/hadoop/appcache/application_1497335254625_0003/container_1497335254625_0003_01_000004/default_container_executor_session.sh: 行 3: /usr/hadoop/hadoop-2.6.0/tmp/hadoopData: 是一个目录
/bin/mv: 目标"/nm-local-dir/nmPrivate/application_1497335254625_0003/container_1497335254625_0003_01_000004/container_1497335254625_0003_01_000004.pid" 不是目录

at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

Container exited with a non-zero exit code 1

17/06/13 15:30:57 INFO mapreduce.Job: map 100% reduce 100%
17/06/13 15:30:57 INFO mapreduce.Job: Job job_1497335254625_0003 failed with state FAILED due to: Task failed task_1497335254625_0003_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

17/06/13 15:30:57 INFO mapreduce.Job: Counters: 12
Job Counters
Failed map tasks=4
Launched map tasks=4
Other local map tasks=3
Data-local map tasks=1
Total time spent by all maps in occupied slots (ms)=14994
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=14994
Total vcore-seconds taken by all map tasks=14994
Total megabyte-seconds taken by all map tasks=15353856
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
hadoop@master:/usr/hadoop/hadoop-2.6.0$

  • 写回答

1条回答 默认 最新

  • wending-Y 博客专家认证 2017-06-13 08:18
    关注

    你看下集群有没有正常运行

    评论

报告相同问题?

悬赏问题

  • ¥15 用三极管设计—个共射极放大电路
  • ¥15 请完成下列相关问题!
  • ¥15 drone 推送镜像时候 purge: true 推送完毕后没有删除对应的镜像,手动拷贝到服务器执行结果正确在样才能让指令自动执行成功删除对应镜像,如何解决?
  • ¥15 求daily translation(DT)偏差订正方法的代码
  • ¥15 js调用html页面需要隐藏某个按钮
  • ¥15 ads仿真结果在圆图上是怎么读数的
  • ¥20 Cotex M3的调试和程序执行方式是什么样的?
  • ¥20 java项目连接sqlserver时报ssl相关错误
  • ¥15 一道python难题3
  • ¥15 牛顿斯科特系数表表示