hadoop集群中，有一个节点Jps看不到datanode ，但在web UI上正常，这是什么 原因 怎么解决？

Question

问题如标题
hadoop dfsadmin -report 的结果如下

DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

19/05/30 09:31:11 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Configured Capacity: 151164198912 (140.78 GB)
Present Capacity: 135626715136 (126.31 GB)
DFS Remaining: 135626620928 (126.31 GB)
DFS Used: 94208 (92 KB)
DFS Used%: 0.00%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
Missing blocks (with replication factor 1): 0

-------------------------------------------------
Live datanodes (3):

Name: 192.168.182.101:50010 (master)
Hostname: master
Decommission Status : Normal
Configured Capacity: 50388066304 (46.93 GB)
DFS Used: 32768 (32 KB)
Non DFS Used: 2861187072 (2.66 GB)
DFS Remaining: 44960407552 (41.87 GB)
DFS Used%: 0.00%
DFS Remaining%: 89.23%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Thu May 30 09:31:11 CST 2019


Name: 192.168.182.102:50010 (node01)
Hostname: node01
Decommission Status : Normal
Configured Capacity: 50388066304 (46.93 GB)
DFS Used: 28672 (28 KB)
Non DFS Used: 2534232064 (2.36 GB)
DFS Remaining: 45287366656 (42.18 GB)
DFS Used%: 0.00%
DFS Remaining%: 89.88%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Thu May 30 09:31:09 CST 2019


Name: 192.168.182.103:50010 (node02)
Hostname: node02
Decommission Status : Normal
Configured Capacity: 50388066304 (46.93 GB)
DFS Used: 32768 (32 KB)
Non DFS Used: 2442747904 (2.27 GB)
DFS Remaining: 45378846720 (42.26 GB)
DFS Used%: 0.00%
DFS Remaining%: 90.06%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Thu May 30 09:31:11 CST 2019

以下是三个节点的jps结果

就这台node01节点jps不到datanode

|

但在Web UI上又能看到 这个有谁了解吗 什么原因 有解决方案吗

Answer 1

问题自己找到解决方法了，查看了没有datanode节点的log,正常就在hadoop目录logs里。 找到datanode.log的日志，主要看Error 和 warn 的提示。
再根据这些日志百度

https://blog.csdn.net/gis_101/article/details/52679914

跟这个情况有点相似，报的warn有所不名，但根本原因可能就出在format后节点uid不一致， 所以在node01节点上
hadoop-2.6.0-cdh5.15.0/data/dfs/data/current

• 这个位置 我是把tmp改为data目录了 可能在你的机器 上是tmp
  

怕错误做把current做了改名备份，再rm -rf current 目录 再 重起了hadoop dfs.sh 和 yarn.sh 到止所有问题都 没有了 jps正常 web UI 也正常

如果你的遇到各种错误，请静心解决，常看日志 事半功倍