2 zixingchedechegulu zixingchedechegulu 于 2016.02.09 11:38 提问

hadoop2的Wordcount测试出错,急!!!

[hadoop@dsp16 hadoop-2.6.0]$ bin/hadoop jar /home/hadoop/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar wordcount /input/ /output/
16/02/09 03:26:57 INFO impl.TimelineClientImpl: Timeline service address: http://dsp16:8188/ws/v1/timeline/
16/02/09 03:26:58 INFO input.FileInputFormat: Total input paths to process : 1
16/02/09 03:26:58 INFO mapreduce.JobSubmitter: number of splits:1
16/02/09 03:26:59 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1454948804760_0002
16/02/09 03:26:59 INFO impl.YarnClientImpl: Submitted application application_1454948804760_0002
16/02/09 03:26:59 INFO mapreduce.Job: The url to track the job: http://dsp16:8088/proxy/application_1454948804760_0002/
16/02/09 03:26:59 INFO mapreduce.Job: Running job: job_1454948804760_0002

yarn日志:
2016-02-08 17:36:54,055 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: dsp18/192.168.0.120:38540. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2016-02-08 17:36:55,056 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: dsp18/192.168.0.120:38540. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2016-02-08 17:36:55,057 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Error cleaning master
java.net.ConnectException: Call From dsp16/192.168.0.118 to dsp18:38540 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:731)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
at org.apache.hadoop.ipc.Client.call(Client.java:1399)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
at com.sun.proxy.$Proxy35.stopContainers(Unknown Source)
at org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagementProtocolPBClientImpl.stopContainers(ContainerManagementProtocolPBClientImpl.java:110)
at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.cleanup(AMLauncher.java:139)
at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.run(AMLauncher.java:268)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494)
at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:607)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:705)
at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:368)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1521)
at org.apache.hadoop.ipc.Client.call(Client.java:1438)
... 9 more
2016-02-09 03:26:58,138 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 2

1个回答

devmiao
devmiao   Ds   Rxr 2016.02.09 21:52
Csdn user default icon
上传中...
上传图片
插入图片
准确详细的回答,更有利于被提问者采纳,从而获得C币。复制、灌水、广告等回答会被删除,是时候展现真正的技术了!
其他相关推荐
CentOS系统下的Hadoop集群(第6期)_WordCount运行详解
Hadoop集群(第6期)_WordCount运行详解   1、MapReduce理论简介   1.1 MapReduce编程模型   MapReduce采用"分而治之"的思想,把对大规模数据集的操作,分发给一个主节点管理下的各个分节点共同完成,然后通过整合各个节点的中间结果,得到最终结果。简单地说,MapReduce就是"任务的分解与结果的汇总"。
关于Hadoop2.7.2运行wordcount
1.每次机器重启后需要重新format否则namenode无法启动的问题,解决办法就是修改core-site.xml,在你的hadoop安装目录添加临时文件夹。           hadoop.tmp.dir           /usr/local/hadoophome/hadoop_tmp 2.新建HDFS输入文件夹input2。 bin/hadoop fs -m
Hadoop2.5.2完全分布式 运行wordcount
[hadoop@lrts216 bin]$./hdfs dfs -mkdir -p /lrts/zhangzk 13/12/19 22:20:41 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applic
Hadoop2.6.0版本MapReudce示例之WordCount(一)
本文详细讲解了Hadoop2.6.0版本MapReudce示例之WordCount的测试数据准备、运行命令、运行过程展示、运行结果查看等过程,并展示了WordCount的代码。
Hadoop2.x实战:WordCount实例运行
本文主要讲了hadoop2.7.2自带的WordCount实例运行
hadoop-2.6.0如何编译,运行WordCount 程序
初学者写,只为备录 MAC系统下:(可能linux也差不多) 1:编译程序 *hadoop-2.6.0(可能2以上一样)的编译环境core包被分散在了hadoop-2.6.0/share文件下 javac -classpath $HADOOP_HOME/share/hadoop/common/hadoop-common-2.6.0.jar:$HADOOP_HOME/share/hadoop
hadoop-2.7.2运行WordCount
初学hadoop的时候往往会被1.x和2.x搞晕,其实二者还是有些不同的。这里演示一下hadoop2.7.2版本的wordcount例子测试及运行流程。 我的hadoop安装在/usr/local/hadoop目录,关键的配置在/usr/local/hadoop/etc/hadoop下的core-site.xml、hdfs-site.xml 、mapred-site.xml这三个文件,这里不说了
hadoop-2.6.0伪分布运行WordCount
hadoop-2.6.0运行WordCount   1、启动Hadoop:     2、创建file 文件夹:  这个是建在本地硬盘上的: 进入该目录: 创建两个 txt 文件: 结果如下: 3、在HDFS上创建输入文件夹目录 input : 把本地硬盘上创建的文件传进input 里面: 查看结果:   4、Hadoop自带的运
Hadoop2.x实战:WordCount、Sort、去重复、average实例MapRedure编写
Hadoop版本:2.6.0Eclipse版本:luna一、     Hadoop做的一个计算单词的实例1、引入jar org.apache.hadoop hadoop-common 2.2.0 org.apache.hadoop hadoop-hdfs 2.2.0 org.apache.hadoop hadoop-c
hadoop2.3安装和wordcount运行验证
以下描述了centos linux(2.6.32-279.el6.x86_64)位机器下,安装32位hadoop 2.3,并通过运行 系统自带的 WordCount 例子来验证服务正确性的步骤。