~Melody~ 2022-08-06 09:00 采纳率: 0%
浏览 161
已结题

hadoop运行自带程序报错

问题遇到的现象和发生背景

hadoop3.3.0运行自带的程序hadoop-mapreduce-examples-3.3.0.jar报错

问题相关代码,请勿粘贴截图

hadoop jar hadoop-mapreduce-examples-3.3.0.jar pi 2 2

运行结果及报错内容

Number of Maps = 2
Samples per Map = 2
Wrote input for Map #0
Wrote input for Map #1
Starting Job
2022-08-06 08:47:52,413 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at node1/192.168.88.128:8032
2022-08-06 08:47:52,806 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/root/.staging/job_1659744647709_0005
2022-08-06 08:47:52,992 INFO input.FileInputFormat: Total input files to process : 2
2022-08-06 08:47:53,059 INFO mapreduce.JobSubmitter: number of splits:2
2022-08-06 08:47:53,225 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1659744647709_0005
2022-08-06 08:47:53,226 INFO mapreduce.JobSubmitter: Executing with tokens: []
2022-08-06 08:47:53,437 INFO conf.Configuration: resource-types.xml not found
2022-08-06 08:47:53,437 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2022-08-06 08:47:53,538 INFO impl.YarnClientImpl: Submitted application application_1659744647709_0005
2022-08-06 08:47:53,621 INFO mapreduce.Job: The url to track the job: http://node1:8088/proxy/application_1659744647709_0005/
2022-08-06 08:47:53,622 INFO mapreduce.Job: Running job: job_1659744647709_0005
2022-08-06 08:48:03,822 INFO mapreduce.Job: Job job_1659744647709_0005 running in uber mode : false
2022-08-06 08:48:03,823 INFO mapreduce.Job: map 0% reduce 0%
2022-08-06 08:48:17,518 INFO mapreduce.Job: Job job_1659744647709_0005 failed with state FAILED due to: Application application_1659744647709_0005 failed 2 times due to AM Container for appattempt_1659744647709_0005_000002 exited with exitCode: 255
Failing this attempt.Diagnostics: [2022-08-06 08:48:17.037]Exception from container-launch.
Container id: container_1659744647709_0005_02_000001
Exit code: 255

[2022-08-06 08:48:17.046]Container exited with a non-zero exit code 255. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Aug 06, 2022 8:48:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class
Aug 06, 2022 8:48:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Aug 06, 2022 8:48:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class
Aug 06, 2022 8:48:12 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM'
Aug 06, 2022 8:48:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Aug 06, 2022 8:48:13 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Aug 06, 2022 8:48:13 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

[2022-08-06 08:48:17.047]Container exited with a non-zero exit code 255. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Aug 06, 2022 8:48:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class
Aug 06, 2022 8:48:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Aug 06, 2022 8:48:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class
Aug 06, 2022 8:48:12 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM'
Aug 06, 2022 8:48:12 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Aug 06, 2022 8:48:13 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Aug 06, 2022 8:48:13 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

For more detailed output, check the application tracking page: http://node1:8088/cluster/app/application_1659744647709_0005 Then click on links to logs of each attempt.
. Failing the application.
2022-08-06 08:48:17,548 INFO mapreduce.Job: Counters: 0
Job job_1659744647709_0005 failed!

我的解答思路和尝试过的方法

配置mapred-site.xml文件无果

<configuration>
<!-- 设置MR程序默认运行模式: yarn集群模式 local本地模式 -->
<property>
 <name>mapred.job.tracker</name>
 <value>node1:9001</value>
</property>
<property>
  <name>mapreduce.framework.name</name>
  <value>yarn</value>
</property>
<!-- MR程序历史服务器端地址 -->
<property>
  <name>mapreduce.jobhistory.address</name>
  <value>node1:10020</value>
</property>
<!-- 历史服务器web端地址 -->
<property>
  <name>mapreduce.jobhistory.webapp.address</name>
  <value>node1:19888</value>
</property>
<property>
  <name>yarn.app.mapreduce.am.env</name>
  <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
</property>
<property>
  <name>mapreduce.map.env</name>
  <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
</property>
<property>
  <name>mapreduce.reduce.env</name>
  <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
</property>
</configuration>

预览有问题,附上截图

img

我想要达到的结果

找出问题所在,使得程序运行成功

  • 写回答

3条回答 默认 最新

  • 与猿共舞 2022-08-06 10:09
    关注

    检查代码编译,检查板本,请升级合适的板本

    评论
  • yy64ll826 2022-08-06 18:58
    关注

    Unable to find 'resource-types.xml'.,这个xml配置没识别出来,你在检查看看几个xml看看

    评论
  • 优质网络系统领域创作者 网络领域新星创作者 2022-08-10 08:17
    关注
    mapreduce.framework.name yarn yarn.app.mapreduce.am.env HADOOP_MAPRED_HOME=/usr/local/hadoop/hadoop-3.1.1 mapreduce.map.env HADOOP_MAPRED_HOME=/usr/local/hadoop/hadoop-3.1.1 mapreduce.reduce.env HADOOP_MAPRED_HOME=/usr/local/hadoop/hadoop-3.1.1
    评论

报告相同问题?

问题事件

  • 系统已结题 8月14日
  • 修改了问题 8月6日
  • 创建了问题 8月6日

悬赏问题

  • ¥20 关于TRPD(波形特征)局部放电特征提取
  • ¥15 C语言快速排序函数纠错
  • ¥15 C#的一个应用程序书写
  • ¥65 页面调接口时加载卡住不响应
  • ¥35 用C语言解决编程问题
  • ¥15 unity硬件连接与使用
  • ¥15 鱼缸加热棒的数据分析或者实际案例也行
  • ¥15 postgresql11安装完成后,pgadmin无法启动
  • ¥15 (标签-无人机|关键词-Matlab代码)
  • ¥15 执行shell脚本提示参数太多