使用Impala的SQL语句,迁移数据至新表报错 1C

$ impala-shell -i slaver2 -f realdata_raw_to_parq.hql
Starting Impala Shell without Kerberos authentication
Connected to slaver2:21000
Server version: impalad version 2.5.0-cdh5.7.2 RELEASE (build 1140f8289dc0d2b1517bcf70454bb4575eb8cc70)
Query: invalidate metadata changqing.t_wtdata_realdata_raw

Fetched 0 row(s) in 0.06s
Query: insert overwrite table changqing.t_wtdata_realdata
partition(acqdate)
select *, to_date(DateAcqTime)
from changqing.t_wtdata_realdata_raw
WARNINGS:
Memory limit exceeded

Error converting column: 12 TO DOUBLE (Data is: null)
Error converting column: 13 TO DOUBLE (Data is: null)
Error converting column: 27 TO DOUBLE (Data is: null)
Error converting column: 51 TO DOUBLE (Data is: null)
Error converting column: 52 TO DOUBLE (Data is: null)
Error converting column: 53 TO DOUBLE (Data is: null)
Error converting column: 54 TO DOUBLE (Data is: null)
Error converting column: 60 TO DOUBLE (Data is: null)
Error converting column: 61 TO DOUBLE (Data is: null)
Error converting column: 62 TO DOUBLE (Data is: null)
Error converting column: 63 TO DOUBLE (Data is: null)
Error converting column: 64 TO DOUBLE (Data is: null)
Error converting column: 65 TO DOUBLE (Data is: null)
Error converting column: 66 TO DOUBLE (Data is: null)
Error converting column: 67 TO DOUBLE (Data is: null)
Error converting column: 68 TO DOUBLE (Data is: null)
Error converting column: 69 TO DOUBLE (Data is: null)
Error converting column: 70 TO DOUBLE (Data is: null)
Error converting column: 71 TO DOUBLE (Data is: null)
Error converting column: 72 TO DOUBLE (Data is: null)
Error converting column: 73 TO DOUBLE (Data is: null)
Error converting column: 74 TO DOUBLE (Data is: null)
Error converting column: 75 TO DOUBLE (Data is: null)
Error converting column: 76 TO DOUBLE (Data is: null)
Error converting column: 77 TO DOUBLE (Data is: null)
Error converting column: 78 TO DOUBLE (Data is: null)
Error converting column: 79 TO DOUBLE (Data is: null)
Error converting column: 80 TO DOUBLE (Data is: null)
file: hdfs://master.hadoop.com:8020/user/hive/warehouse/changqing.db/t_wtdata_realdata_raw/part-m-00003_copy_3
record: 10,2015-02-01 00:00:00.0,10,-7,-6,409,408,408,0,0,0,50.03,null,null,0.726,2.52,2.98,2.77,-1.44,303.6,0.09,89.0,6,32.6,27.0,27.8,18.4,null,23.4,20.9,30.2,32.6,27.7,5.6,151.0,315.5,-0.4,7.0,3.0,9.9,-9.0E-4,0.0051,0.0,-44.5,1,1,233712,100.0,100.0,100.0,3,null,null,null,null,-0.3,11.0,89.0,89.0,89.0,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,0.0
Error converting column: 12 TO DOUBLE (Data is: null)
Error converting column: 13 TO DOUBLE (Data is: null)
Error converting column: 27 TO DOUBLE (Data is: null)
Error converting column: 51 TO DOUBLE (Data is: null)
Error converting column: 52 TO DOUBLE (Data is: null)
Error converting column: 53 TO DOUBLE (Data is: null)
Error converting column: 54 TO DOUBLE (Data is: null)
Error converting column: 60 TO DOUBLE (Data is: null)
Error converting column: 61 TO DOUBLE (Data is: null)
Error converting column: 62 TO DOUBLE (Data is: null)
Error converting column: 63 TO DOUBLE (Data is: null)
Error converting column: 64 TO DOUBLE (Data is: null)
Error converting column: 65 TO DOUBLE (Data is: null)
Error converting column: 66 TO DOUBLE (Data is: null)
Error converting column: 67 TO DOUBLE (Data is: null)
Error converting column: 68 TO DOUBLE (Data is: null)
Error converting column: 69 TO DOUBLE (Data is: null)
Error converting column: 70 TO DOUBLE (Data is: null)
Error converting column: 71 TO DOUBLE (Data is: null)
Error converting column: 72 TO DOUBLE (Data is: null)
Error converting column: 73 TO DOUBLE (Data is: null)
Error converting column: 74 TO DOUBLE (Data is: null)
Error converting column: 75 TO DOUBLE (Data is: null)
Error converting column: 76 TO DOUBLE (Data is: null)
Error converting column: 77 TO DOUBLE (Data is: null)
Error converting column: 78 TO DOUBLE (Data is: null)
Error converting column: 79 TO DOUBLE (Data is: null)
Error converting column: 80 TO DOUBLE (Data is: null)

Could not execute command: insert overwrite table changqing.t_wtdata_realdata
partition(acqdate)
select *, to_date(DateAcqTime)
from changqing.t_wtdata_realdata_raw

2个回答

追加:虚机的内存设置8G,是内存溢出的问题吗?impala是否对硬件配置有要求?

问题解决了,主要是内存溢出的问题,虚拟机上内存不够impala使用,在服务器上Ok

Csdn user default icon
上传中...
上传图片
插入图片
抄袭、复制答案,以达到刷声望分或其他目的的行为,在CSDN问答是严格禁止的,一经发现立刻封号。是时候展现真正的技术了!
立即提问