虚拟硬盘空间总20g,但仅用了3g,内存总容量1624MB。本以为容量不足原因扩容了,查找了网上的方法在yarn-site.xml中添加设置:
yarn-site.xml 结尾添加:
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>1600</value>
</property>
<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>1024</value>
</property>
<property>
<name>yarn.nodemanager.vmem-pmem-ratio</name>
<value>2.1</value>
</property>
但是依然没有效果,之前配置yarn.nodemanager.resource.memory-mb项为1024,运行时出现报错所需内存1536>可调用内存1524,最后添加到1600
查看hadoop日志文件夹下的yarn-root-resourcemanager-master.log,发现最近一次的日志如下:
INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1592553833488_0001_000001 State change from SUBMITTED to SCHEDULED
执行sqoop指令如下:
sqoop import -connect jdbc:mysql://master:3306/db_jbw -username sqoop -password 123 -table tbl_sqoop -m 1 -target-dir /mysqoop/out
求大神指教!!!