tubertan 2017-04-28 03:44 采纳率: 0%
浏览 4692
已结题

使用Impala的SQL语句,迁移数据至新表报错

$ impala-shell -i slaver2 -f realdata_raw_to_parq.hql
Starting Impala Shell without Kerberos authentication
Connected to slaver2:21000
Server version: impalad version 2.5.0-cdh5.7.2 RELEASE (build 1140f8289dc0d2b1517bcf70454bb4575eb8cc70)
Query: invalidate metadata changqing.t_wtdata_realdata_raw

Fetched 0 row(s) in 0.06s
Query: insert overwrite table changqing.t_wtdata_realdata
partition(acqdate)
select *, to_date(DateAcqTime)
from changqing.t_wtdata_realdata_raw
WARNINGS:
Memory limit exceeded

Error converting column: 12 TO DOUBLE (Data is: null)
Error converting column: 13 TO DOUBLE (Data is: null)
Error converting column: 27 TO DOUBLE (Data is: null)
Error converting column: 51 TO DOUBLE (Data is: null)
Error converting column: 52 TO DOUBLE (Data is: null)
Error converting column: 53 TO DOUBLE (Data is: null)
Error converting column: 54 TO DOUBLE (Data is: null)
Error converting column: 60 TO DOUBLE (Data is: null)
Error converting column: 61 TO DOUBLE (Data is: null)
Error converting column: 62 TO DOUBLE (Data is: null)
Error converting column: 63 TO DOUBLE (Data is: null)
Error converting column: 64 TO DOUBLE (Data is: null)
Error converting column: 65 TO DOUBLE (Data is: null)
Error converting column: 66 TO DOUBLE (Data is: null)
Error converting column: 67 TO DOUBLE (Data is: null)
Error converting column: 68 TO DOUBLE (Data is: null)
Error converting column: 69 TO DOUBLE (Data is: null)
Error converting column: 70 TO DOUBLE (Data is: null)
Error converting column: 71 TO DOUBLE (Data is: null)
Error converting column: 72 TO DOUBLE (Data is: null)
Error converting column: 73 TO DOUBLE (Data is: null)
Error converting column: 74 TO DOUBLE (Data is: null)
Error converting column: 75 TO DOUBLE (Data is: null)
Error converting column: 76 TO DOUBLE (Data is: null)
Error converting column: 77 TO DOUBLE (Data is: null)
Error converting column: 78 TO DOUBLE (Data is: null)
Error converting column: 79 TO DOUBLE (Data is: null)
Error converting column: 80 TO DOUBLE (Data is: null)
file: hdfs://master.hadoop.com:8020/user/hive/warehouse/changqing.db/t_wtdata_realdata_raw/part-m-00003_copy_3
record: 10,2015-02-01 00:00:00.0,10,-7,-6,409,408,408,0,0,0,50.03,null,null,0.726,2.52,2.98,2.77,-1.44,303.6,0.09,89.0,6,32.6,27.0,27.8,18.4,null,23.4,20.9,30.2,32.6,27.7,5.6,151.0,315.5,-0.4,7.0,3.0,9.9,-9.0E-4,0.0051,0.0,-44.5,1,1,233712,100.0,100.0,100.0,3,null,null,null,null,-0.3,11.0,89.0,89.0,89.0,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,0.0
Error converting column: 12 TO DOUBLE (Data is: null)
Error converting column: 13 TO DOUBLE (Data is: null)
Error converting column: 27 TO DOUBLE (Data is: null)
Error converting column: 51 TO DOUBLE (Data is: null)
Error converting column: 52 TO DOUBLE (Data is: null)
Error converting column: 53 TO DOUBLE (Data is: null)
Error converting column: 54 TO DOUBLE (Data is: null)
Error converting column: 60 TO DOUBLE (Data is: null)
Error converting column: 61 TO DOUBLE (Data is: null)
Error converting column: 62 TO DOUBLE (Data is: null)
Error converting column: 63 TO DOUBLE (Data is: null)
Error converting column: 64 TO DOUBLE (Data is: null)
Error converting column: 65 TO DOUBLE (Data is: null)
Error converting column: 66 TO DOUBLE (Data is: null)
Error converting column: 67 TO DOUBLE (Data is: null)
Error converting column: 68 TO DOUBLE (Data is: null)
Error converting column: 69 TO DOUBLE (Data is: null)
Error converting column: 70 TO DOUBLE (Data is: null)
Error converting column: 71 TO DOUBLE (Data is: null)
Error converting column: 72 TO DOUBLE (Data is: null)
Error converting column: 73 TO DOUBLE (Data is: null)
Error converting column: 74 TO DOUBLE (Data is: null)
Error converting column: 75 TO DOUBLE (Data is: null)
Error converting column: 76 TO DOUBLE (Data is: null)
Error converting column: 77 TO DOUBLE (Data is: null)
Error converting column: 78 TO DOUBLE (Data is: null)
Error converting column: 79 TO DOUBLE (Data is: null)
Error converting column: 80 TO DOUBLE (Data is: null)

Could not execute command: insert overwrite table changqing.t_wtdata_realdata
partition(acqdate)
select *, to_date(DateAcqTime)
from changqing.t_wtdata_realdata_raw

  • 写回答

2条回答

  • tubertan 2017-04-28 03:49
    关注

    追加:虚机的内存设置8G,是内存溢出的问题吗?impala是否对硬件配置有要求?

    评论

报告相同问题?

悬赏问题

  • ¥15 用前端向数据库插入数据,通过debug发现数据能走到后端,但是放行之后就会提示错误
  • ¥15 python天天向上类似问题,但没有清零
  • ¥30 3天&7天&&15天&销量如何统计同一行
  • ¥30 帮我写一段可以读取LD2450数据并计算距离的Arduino代码
  • ¥15 C#调用python代码(python带有库)
  • ¥15 矩阵加法的规则是两个矩阵中对应位置的数的绝对值进行加和
  • ¥15 活动选择题。最多可以参加几个项目?
  • ¥15 飞机曲面部件如机翼,壁板等具体的孔位模型
  • ¥15 vs2019中数据导出问题
  • ¥20 云服务Linux系统TCP-MSS值修改?