Afterall42
Afterall42
采纳率50%
2020-09-21 17:14

hadoop写入测试成功但读取测试失败

已采纳

hadoop jar /export/servers/hadoop-2.7.5/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.5.jar TestDFSIO -read -nrFiles 10 -fileSize 10M

指令输入后显示

20/09/21 17:00:13 INFO fs.TestDFSIO: TestDFSIO.1.8
java.lang.IllegalArgumentException: Unsupported ByteMultiple M
at org.apache.hadoop.fs.TestDFSIO$ByteMultiple.parseString(TestDFSIO.java:170)
at org.apache.hadoop.fs.TestDFSIO.parseSize(TestDFSIO.java:865)
at org.apache.hadoop.fs.TestDFSIO.run(TestDFSIO.java:768)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.hadoop.fs.TestDFSIO.main(TestDFSIO.java:713)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:130)
at org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:138)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

  • 点赞
  • 写回答
  • 关注问题
  • 收藏
  • 复制链接分享
  • 邀请回答

2条回答

  • caozhy 回答这么多问题就耍赖把我的积分一笔勾销了 6月前

    at org.apache.hadoop.fs.TestDFSIO$ByteMultiple.parseString(TestDFSIO.java:170)
    这里解析错误,是不是数据格式的问题,检查下

    点赞 评论 复制链接分享
  • weixin_37933207 想成为大白 4月前

    参数格式有问题,10M改为10MB就可以了

    点赞 评论 复制链接分享