2 ych271033578 ych271033578 于 2015.07.13 23:26 提问

windows平台安装Hadoop,启动报错No such file or directory

这几天在折腾windows下安装Hadoop,完全按照网上写的标准步骤。
参考博文:http://www.cnblogs.com/kinglau/p/3270160.html
好不容易到最后了,在启动Hadoop时,一直报错如标题。

格式化hdfs日志:
$ bin/hadoop namenode -format
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
15/07/13 23:07:53 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = 58-PC/192.168.0.102
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 2.7.0
STARTUP_MSG: classpath = D:\tools\cygwin32\home\lenovo\hadoop\etc\hadoop;D:\tools\cygwin32\home\lenovo\hadoop\share\hadoop\common\lib\activation-1.1.jar;D:\tools\cygwin32\home\lenovo\hadoop\share\hadoop\common\lib\apacheds-i18n-2.0.0-M15.jar;D:\tools\cygwin32\home\lenovo\hadoop\share\hadoop\common\lib\apacheds-kerberos-codec-2.0.0-M15.jar;D:\tools\cygwin32\home\lenovo\hadoop\share\hadoop\common\lib\api-asn1-api-1.0.0-M20.jar;D:\tools\cygwin32\home\lenovo\hadoop\share\hadoop\common\lib\api-util-1.0.0-M20.jar;D:\tools\cygwin32\home\lenovo\hadoop\share\hadoop\common\lib\asm-3.2.jar;D:\tools\cygwin32\home\lenovo\hadoop\share\hadoop\common\lib\avro-1.7.4.jar;D:\tools\cygwin32\home\lenovo\hadoop\share\hadoop\common\lib\commons-beanutils-1.7.0.jar;D:\tools\cygwin32\home\lenovo\hadoop\share\hadoop\common\lib\commons-beanutils-core-1.8.0.jar;D:\tools\cygwin32\home\lenovo\hadoop\share\hadoop\common\lib\commons-cli-1.2.jar;D:\tools\cygwin32\home\lenovo\hadoop\share\hadoop\common\lib\commons-codec-1.4.jar;D:\tools\cygwin32\home\lenovo\had
。。。。。。。。。。。。。。。。

STARTUP_MSG: java = 1.8.0_31
************************************************************/
15/07/13 23:07:53 INFO namenode.NameNode: createNameNode [-format]
15/07/13 23:07:54 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: CID-052de37d-497f-4dd3-80bc-6c6c8a26d5d0
15/07/13 23:07:55 INFO namenode.FSNamesystem: No KeyProvider found.
15/07/13 23:07:55 INFO namenode.FSNamesystem: fsLock is fair:true
15/07/13 23:07:56 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000
15/07/13 23:07:56 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true
15/07/13 23:07:56 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
15/07/13 23:07:56 INFO blockmanagement.BlockManager: The block deletion will start around 2015 ▒▒▒▒ 13 23:07:56
15/07/13 23:07:56 INFO util.GSet: Computing capacity for map BlocksMap
15/07/13 23:07:56 INFO util.GSet: VM type = 32-bit
15/07/13 23:07:56 INFO util.GSet: 2.0% max memory 966.7 MB = 19.3 MB
15/07/13 23:07:56 INFO util.GSet: capacity = 2^22 = 4194304 entries
15/07/13 23:07:56 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false
15/07/13 23:07:56 INFO blockmanagement.BlockManager: defaultReplication = 1
15/07/13 23:07:56 INFO blockmanagement.BlockManager: maxReplication = 512
15/07/13 23:07:56 INFO blockmanagement.BlockManager: minReplication = 1
15/07/13 23:07:56 INFO blockmanagement.BlockManager: maxReplicationStreams = 2
15/07/13 23:07:56 INFO blockmanagement.BlockManager: shouldCheckForEnoughRacks = false
15/07/13 23:07:56 INFO blockmanagement.BlockManager: replicationRecheckInterval = 3000
15/07/13 23:07:56 INFO blockmanagement.BlockManager: encryptDataTransfer = false
15/07/13 23:07:56 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000
15/07/13 23:07:56 INFO namenode.FSNamesystem: fsOwner = lenovo (auth:SIMPLE)
15/07/13 23:07:56 INFO namenode.FSNamesystem: supergroup = supergroup
15/07/13 23:07:56 INFO namenode.FSNamesystem: isPermissionEnabled = true
15/07/13 23:07:56 INFO namenode.FSNamesystem: HA Enabled: false
15/07/13 23:07:56 INFO namenode.FSNamesystem: Append Enabled: true
15/07/13 23:07:56 INFO util.GSet: Computing capacity for map INodeMap

6个回答

ych271033578
ych271033578   2015.07.13 23:29

15/07/13 23:07:56 INFO util.GSet: VM type = 32-bit
15/07/13 23:07:56 INFO util.GSet: 1.0% max memory 966.7 MB = 9.7 MB
15/07/13 23:07:56 INFO util.GSet: capacity = 2^21 = 2097152 entries
15/07/13 23:07:56 INFO namenode.FSDirectory: ACLs enabled? false
15/07/13 23:07:56 INFO namenode.FSDirectory: XAttrs enabled? true
15/07/13 23:07:56 INFO namenode.FSDirectory: Maximum size of an xattr: 16384
15/07/13 23:07:56 INFO namenode.NameNode: Caching file names occuring more than 10 times
15/07/13 23:07:56 INFO util.GSet: Computing capacity for map cachedBlocks
15/07/13 23:07:56 INFO util.GSet: VM type = 32-bit
15/07/13 23:07:56 INFO util.GSet: 0.25% max memory 966.7 MB = 2.4 MB
15/07/13 23:07:56 INFO util.GSet: capacity = 2^19 = 524288 entries
15/07/13 23:07:56 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
15/07/13 23:07:56 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0
15/07/13 23:07:56 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000
15/07/13 23:07:56 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
15/07/13 23:07:56 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
15/07/13 23:07:56 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25
15/07/13 23:07:56 INFO namenode.FSNamesystem: Retry cache on namenode is enabled
15/07/13 23:07:56 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
15/07/13 23:07:56 INFO util.GSet: Computing capacity for map NameNodeRetryCache
15/07/13 23:07:56 INFO util.GSet: VM type = 32-bit
15/07/13 23:07:56 INFO util.GSet: 0.029999999329447746% max memory 966.7 MB = 297.0 KB
15/07/13 23:07:56 INFO util.GSet: capacity = 2^16 = 65536 entries
Re-format filesystem in Storage Directory \tmp\hadoop-lenovo\dfs\name ? (Y or N) y
15/07/13 23:08:25 INFO namenode.FSImage: Allocated new BlockPoolId: BP-1334721993-192.168.0.102-1436800105782
15/07/13 23:08:25 INFO common.Storage: Storage directory \tmp\hadoop-lenovo\dfs\name has been successfully formatted.
15/07/13 23:08:26 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
15/07/13 23:08:26 INFO util.ExitUtil: Exiting with status 0
15/07/13 23:08:26 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at 58-PC/192.168.0.102
************************************************************/

lenovo@58-PC ~/hadoop
$ bin/start-all.sh
-bash: bin/start-all.sh: No such file or directory

ych271033578
ych271033578   2015.07.13 23:29

折腾几天了,急盼大神指教。

caozhy
caozhy   Ds   Rxr 2015.07.13 23:36
lovehuangjiaju
lovehuangjiaju 回复ych271033578: 另外,最好不要在window环境下跑hadoop,建Linux虚拟机跑,因为现在大多数人都是在linux下进行hadoop开发,网上很多答案都是解决linux下的hadoop问题
2 年多之前 回复
lovehuangjiaju
lovehuangjiaju 回复ych271033578: 你Hadoop版本是多少?hadoop 2.0之后的start-all.sh已经被放在sbin目录下了
2 年多之前 回复
ych271033578
ych271033578 这个回答解决不了问题,还望详细指点
2 年多之前 回复
u012216727
u012216727   Ds   Rxr 2015.07.14 08:42
ych271033578
ych271033578 未能解决问题,说的太笼统,另外报的错误和他这个也不一样
2 年多之前 回复
ych271033578
ych271033578   2015.07.15 11:23

问题依然还没解决,自己顶一下

CSDNXIAOS
CSDNXIAOS   2015.07.16 15:26

在使用cygwin装完hadoop后,输入命令

./hadoop version

出现如下错误
./hadoop:line 297:c:\java\jdk1.6.0_05\bin/bin/java:No such file or directory
./hadoop:line 345:c:\Java\jdk1.6.0_05\bin/bin/java:No such file o......
答案就在这里:hadoop no such file or directory问题
----------------------Hi,地球人,我是问答机器人小S,上面的内容就是我狂拽酷炫叼炸天的答案,除了赞同,你还有别的选择吗?

Csdn user default icon
上传中...
上传图片
插入图片