在搭建hadoop集群时没有启动了有datanode但是在jps时没有

Question

错误信息如下:
2021-10-12 16:31:11,411 WARN org.apache.hadoop.hdfs.server.common.Storage: Failed to add storage directory [DISK]file:/opt/hadoop/tmp/hadoop-hadoop/dfs/data
java.io.IOException: Incompatible clusterIDs in /opt/hadoop/tmp/hadoop-hadoop/dfs/data: namenode clusterID = CID-78658b6d-dfb8-4699-ab91-c5901f9db32f; datanode clusterID = CID-3e049366-6124-4bb4-8bcd-cc0c7c112081
at org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:744)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadStorageDirectory(DataStorage.java:294)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadDataStorage(DataStorage.java:407)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:387)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:559)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1748)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1684)
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:392)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:282)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:829)
at java.lang.Thread.run(Thread.java:748)
2021-10-12 16:31:11,413 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool (Datanode Uuid 0893d4f5-2f05-4060-b859-f27985ad3169) service to hadoop1/192.168.13.129:9000. Exiting.
java.io.IOException: All specified directories have failed to load.
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:560)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1748)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1684)
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:392)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:282)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:829)
at java.lang.Thread.run(Thread.java:748)
2021-10-12 16:31:11,413 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool (Datanode Uuid 0893d4f5-2f05-4060-b859-f27985ad3169) service to hadoop1/192.168.13.129:9000

Answer 1

是格式化了两次 nameNode嘛，导致dataNode中存储的nameNode的clusterID与nameNode本身的不符。
去这个路径下 /opt/hadoop/tmp/hadoop-hadoop/dfs/data/current 修改VERSION文件
clusterID如果等于CID-3e049366-6124-4bb4-8bcd-cc0c7c112081就换成CID-78658b6d-dfb8-4699-ab91-c5901f9db32f