2020-12-07 17:13:32,328 WARN [org.apache.hadoop.util.NativeCodeLoader] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2020-12-07 17:13:33,406 INFO [org.apache.hadoop.yarn.client.RMProxy] - Connecting to ResourceManager at master/192.168.109.11:8032
2020-12-07 17:13:34,154 WARN [org.apache.hadoop.mapreduce.JobResourceUploader] - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2020-12-07 17:13:34,346 INFO [org.apache.hadoop.hdfs.DFSClient] - Exception in createBlockOutputStream
java.io.IOException: Got error, status message , ack with firstBadLink as 192.168.109.11:50010
at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:142)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1334)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1237)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:449)
2020-12-07 17:13:34,346 INFO [org.apache.hadoop.hdfs.DFSClient] - Abandoning BP-1592468033-192.168.109.11-1607310219243:blk_1073741884_1060
2020-12-07 17:13:34,350 INFO [org.apache.hadoop.hdfs.DFSClient] - Excluding datanode DatanodeInfoWithStorage[192.168.109.11:50010,DS-0a35e535-67c7-40b6-82b8-45fa39368958,DISK]
2020-12-07 17:13:35,167 INFO [org.apache.hadoop.mapreduce.lib.input.FileInputFormat] - Total input paths to process : 1
2020-12-07 17:13:35,211 INFO [org.apache.hadoop.hdfs.DFSClient] - Exception in createBlockOutputStream
java.io.IOException: Got error, status message , ack with firstBadLink as 192.168.109.11:50010
at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:142)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1334)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1237)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:449)
2020-12-07 17:13:35,211 INFO [org.apache.hadoop.hdfs.DFSClient] - Abandoning BP-1592468033-192.168.109.11-1607310219243:blk_1073741886_1062
2020-12-07 17:13:35,213 INFO [org.apache.hadoop.hdfs.DFSClient] - Excluding datanode DatanodeInfoWithStorage[192.168.109.11:50010,DS-0a35e535-67c7-40b6-82b8-45fa39368958,DISK]
2020-12-07 17:13:35,266 INFO [org.apache.hadoop.mapreduce.JobSubmitter] - number of splits:1
2020-12-07 17:13:35,280 INFO [org.apache.hadoop.conf.Configuration.deprecation] - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2020-12-07 17:13:35,379 INFO [org.apache.hadoop.mapreduce.JobSubmitter] - Submitting tokens for job: job_1607330225186_0006
2020-12-07 17:13:35,545 INFO [org.apache.hadoop.yarn.client.api.impl.YarnClientImpl] - Submitted application application_1607330225186_0006
2020-12-07 17:13:35,568 INFO [org.apache.hadoop.mapreduce.Job] - The url to track the job: http://master:8088/proxy/application_1607330225186_0006/
2020-12-07 17:13:35,570 INFO [org.apache.hadoop.mapreduce.Job] - Running job: job_1607330225186_0006
为什么会报这个错,防火墙问题也排除了,集群也开了,求大神解决!!!!!
- 写回答
- 好问题 0 提建议
- 关注问题
- 邀请回答
-