Error Carrot
2021-10-23 23:57
采纳率: 0%
浏览 84

提交spark任务到yarn,警告:WARN cluster.YarnScheduler: Initial job has not accepted any resources;

求问,把一个spark任务提交到yarn上执行,一直在报一个警告,没有成功执行,从yarn上看这个任务好像完全没有申请到资源,求问如何解决,或者我应该从哪里下手解决呢
提交任务的命令:

spark-submit --master yarn --class com.carrot.spark.sql1.demo09 /opt/SparkDemo.jar

警告日志:

2021-10-23 23:46:20,940 INFO cluster.YarnScheduler: Adding task set 1.0 with 2 tasks resource profile 0
2021-10-23 23:46:35,913 WARN cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

3条回答 默认 最新

相关推荐 更多相似问题