运行结果及报错内容
Query ID = yjx_20220513233834_95388cca-9bf1-43aa-b27f-9d8ce7ffe08a
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=
In order to set a constant number of reducers:
set mapreduce.job.reduces=
Starting Job = job_1652456158826_0001, Tracking URL = http://hadoop103:8088/proxy/application_1652456158826_0001/
Kill Command = /opt/module/hadoop-3.1.3/bin/mapred job -kill job_1652456158826_0001
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
2022-05-13 23:39:18,314 Stage-1 map = 0%, reduce = 0%
2022-05-13 23:39:57,247 Stage-1 map = 100%, reduce = 100%
Ended Job = job_1652456158826_0001 with errors
Error during job, obtaining debugging information...
Examining task ID: task_1652456158826_0001_m_000000 (and more) from job job_1652456158826_0001
Task with the most failures(4):
Task ID:
task_1652456158826_0001_m_000000
Diagnostic Messages for this Task:
[2022-05-13 23:39:56.230]Container [pid=2690,containerID=container_1652456158826_0001_01_000005] is running 314223104B beyond the 'VIRTUAL' memory limit. Current usage: 155.5 MB of 1 GB physical memory used; 2.4 GB of 2.1 GB virtual memory used. Killing container.
Dump of the process-tree for container_1652456158826_0001_01_000005 :
|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
|- 2690 2689 2690 2690 (bash) 0 1 9789440 290 /bin/bash -c /opt/module/jdk1.8.0_212/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx820m -Djava.io.tmpdir=/opt/module/hadoop-3.1.3/data/nm-local-dir/usercache/yjx/appcache/application_1652456158826_0001/container_1652456158826_0001_01_000005/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/opt/module/hadoop-3.1.3/logs/userlogs/application_1652456158826_0001/container_1652456158826_0001_01_000005 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 192.168.1.104 45926 attempt_1652456158826_0001_m_000000_3 5 1>/opt/module/hadoop-3.1.3/logs/userlogs/application_1652456158826_0001/container_1652456158826_0001_01_000005/stdout 2>/opt/module/hadoop-3.1.3/logs/userlogs/application_1652456158826_0001/container_1652456158826_0001_01_000005/stderr
|- 2703 2690 2690 2690 (java) 599 277 2559291392 39519 /opt/module/jdk1.8.0_212/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx820m -Djava.io.tmpdir=/opt/module/hadoop-3.1.3/data/nm-local-dir/usercache/yjx/appcache/application_1652456158826_0001/container_1652456158826_0001_01_000005/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/opt/module/hadoop-3.1.3/logs/userlogs/application_1652456158826_0001/container_1652456158826_0001_01_000005 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 192.168.1.104 45926 attempt_1652456158826_0001_m_000000_3 5
[2022-05-13 23:39:56.336]Container killed on request. Exit code is 143
[2022-05-13 23:39:56.373]Container exited with a non-zero exit code 143.
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
Stage-Stage-1: Map: 1 Reduce: 1 HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 msec
