hive jdbc执行报错MoveTask

详细错误
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:296)
at org.apache.hive.jdbc.HiveStatement.executeUpdate(HiveStatement.java:406)
at com.dmp.dmp_hive.service.Media_toolsService.loadDate(Media_toolsService.java:96)
at com.dmp.dmp_hive.service.Media_toolsService.run(Media_toolsService.java:38)
at com.dmp.dmp_hive.test.Test.main(Test.java:48)

Csdn user default icon
上传中...
上传图片
插入图片
抄袭、复制答案,以达到刷声望分或其他目的的行为,在CSDN问答是严格禁止的,一经发现立刻封号。是时候展现真正的技术了!
其他相关推荐
hive任务中MoveTask的策略
Hive版本:1.2.1         hive将sql转换为mapreduce任务,最后结束的时候可能涉及到将临时文件存到目标目录中。         hive1.2.1版本临时文件有可能是存放在当前的hive工作空间中。          例如:          insert overwrite table  temp.test select id,name from dwd.tk
sqoop执行hive导入报错
错误日志: 2018-09-17 14:50:57,932 INFO [OutputFormatLoader-consumer] com.chinacreator.sqoop.connector.hive.HiveLoader: load sql:LOAD DATA INPATH '/f95af4b623d14fba929e4ef26facd456.txt' INTO TABLE wfxtes...
hive执行删除表操作报错
在hive执行drop table table_name时报下错SemanticException Unable to fetch table movie. For direct MetaStore DB connections, we don't support retries at the client level. 报错原因: hive是基于mysql的数据库,需要连接mysql,由于m...
执行hive时 mapreduce报错
hive> select count(*) from testkkk; Total jobs = 1 Launching Job 1 out of 1 Number of reduce tasks determined at compile...
hive执行语句时报错
我那个大神哦..昨天都运行的好的..今天打开hive,就执行show databases就报下面的异常错误,小女子真不知道是怎么解决的.. 百度谷歌了很久也没找到解决的办法,求大侠赐教啊...rn我是将mysql作为hive的原数据库的,hive-site.xml已修改,mysql的jar已放在lib里面了..rn[code=java]rnError in metadata: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClientrnFAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTaskrn[/code]rn类似于:rn[url=http://bbs.csdn.net/topics/390481732][/url]rn[url=http://jeffxie.blog.51cto.com/1365360/317980][/url]rn[url=http://blog.csdn.net/joomlaer/article/details/8960512][/url]rn以上的解决方法,小女子也试了 还是不的行啊... rn[img=https://forum.csdn.net/PointForum/ui/scripts/csdn/Plugin/003/monkey/11.gif][/img]
在root用户执行hive命令报错
Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.security.AccessControlException: Permission denied: user=root, access=WRITE, inode="/user/root":hdfs:hdfs:drwxr-xr-x         a
hive jdbc方式执行触发mr的查询报错求解
rn不触发mr的sql可以正常执行,触发mr的就报错rn报错执行sql = "select count(1) from test1";rnjava.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTaskrn at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:296)rn at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:392)rn at hive.TestMr.main(TestMr.java:28)
hive jdbc执行sql报错java.sql.SQLException: Error while processing statement
完整错误rnjava.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTaskrn at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:296)rn at org.apache.hive.jdbc.HiveStatement.executeUpdate(HiveStatement.java:406)rn at com.dmp.dmp_hive.service.Media_toolsService.loadDate(Media_toolsService.java:96)rn at com.dmp.dmp_hive.service.Media_toolsService.run(Media_toolsService.java:38)rn at com.dmp.dmp_hive.test.Test.main(Test.java:48)rnrn执行的load语句,求大神啊
idea使用jdbc连接hive的报错总结
1、java.sql.SQLException: org.apache.thrift.transport.TTransportException: SASL authentication not complete 遇到这种错误,首先看看是否还未进行工作已经关闭了连接 public void insert() throws Exception{ PreparedStatemen...
hive之jdbc
NULL 博文链接:https://fypop.iteye.com/blog/2241060
Hive编程指南-JDBC连接、脚本执行
摘要:本文主要讲了如何通过java来连接Hive,以及如何执行hive脚本
hive执行插入数据(insert....)时报错
2014-01-28 10:25:35,230 Stage-0 map = 0%, reduce = 0%rn2014-01-28 10:26:02,670 Stage-0 map = 100%, reduce = 100%rnEnded Job = job_201401241752_0013 with errorsrnError during job, obtaining debugging information...rnJob Tracking URL: http://Master:50030/jobdetails.jsp?jobid=job_201401241752_0013rnExamining task ID: task_201401241752_0013_m_000002 (and more) from job job_201401241752_0013rnrnTask with the most failures(4): rn-----rnTask ID:rn task_201401241752_0013_m_000000rnrnURL:rn http://Master:50030/taskdetails.jsp?jobid=job_201401241752_0013&tipid=task_201401241752_0013_m_000000rn-----rnDiagnostic Messages for this Task:rnjava.lang.RuntimeException: Error in configuring objectrn at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)rn at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)rn at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)rn at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:413)rn at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)rn at org.apache.hadoop.mapred.Child$4.run(Child.java:268)rn at java.security.AccessController.doPrivileged(Native Method)rn at javax.security.auth.Subject.doAs(Subject.java:396)rn at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)rn at org.apache.hadoop.mapred.Child.main(Child.java:262)rnCaused by: java.lang.reflect.InvocationTargetExceptionrn at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)rn at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)rn at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jarnrnFAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTaskrnMapReduce Jobs Launched: rnJob 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAILrnTotal MapReduce CPU Time Spent: 0 msecrnrnrn这是什么问题呢?
执行 hive sql ,报错:断开的管道
在集群正常的情况下,执行hql会报错:断开的管道,由于hql已经运行很久了,保证并不是hql的语句错误, 所以查看磁盘使用情况,执行命令: df -lh  文件系统                 容量  已用  可用 已用% 挂载点 /dev/mapper/centos-root   50G   17G   34G   33% / devtmpfs                  16
hive执行insert语句时报错
错误提示如下: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask MapReduce Jobs Launched: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 FAIL resolution...
急问,oozie执行hive脚本报错
装的cloudera cdh5,在oozie上执行hive的脚本,脚本只有一个select语句“select * from apprunfstat”,报下面的找不到表的错误。rn但是直接在hive查询编辑器执行此sql语句 或者 在hive shell上执行此sql语句,都是可以正常执行并出结果的。rn有没有知道是什么原因?谢谢rnrnrn21756 [main] INFO org.apache.hadoop.hive.metastore.ObjectStore - Initialized ObjectStorern 22087 [main] WARN org.apache.hadoop.hive.metastore.ObjectStore - Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 0.13.0rn 22909 [main] INFO org.apache.hadoop.hive.metastore.HiveMetaStore - Added admin role in metastorern 22921 [main] INFO org.apache.hadoop.hive.metastore.HiveMetaStore - Added public role in metastorern 23184 [main] INFO org.apache.hadoop.hive.metastore.HiveMetaStore - No user is added in admin role, since config is emptyrn 23454 [main] INFO org.apache.hadoop.hive.ql.session.SessionState - No Tez session required at this point. hive.execution.engine=mr.rn 23500 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - rn 23501 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - rn 23501 [main] INFO org.apache.hadoop.hive.ql.Driver - Concurrency mode is disabled, not creating a lock managerrn 23511 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - rn 23608 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - rn 23620 [main] INFO hive.ql.parse.ParseDriver - Parsing command: select * from apprunfstatrn 24333 [main] INFO hive.ql.parse.ParseDriver - Parse Completedrn 24339 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - rn 24340 [main] INFO org.apache.hadoop.hive.ql.log.PerfLogger - rn 24478 [main] INFO org.apache.hadoop.hive.ql.parse.SemanticAnalyzer - Starting Semantic Analysisrn 24480 [main] INFO org.apache.hadoop.hive.ql.parse.SemanticAnalyzer - Completed phase 1 of Semantic Analysisrn 24480 [main] INFO org.apache.hadoop.hive.ql.parse.SemanticAnalyzer - Get metadata for source tablesrn 24766 [main] INFO org.apache.hadoop.hive.metastore.HiveMetaStore - 0: get_table : db=default tbl=apprunfstatrn 24767 [main] INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit - ugi=admin ip=unknown-ip-addr cmd=get_table : db=default tbl=apprunfstatrn 24814 [main] ERROR hive.ql.metadata.Hive - NoSuchObjectException(message:default.apprunfstat table not found)rn at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1569)rn at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)rn at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)rn at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)rn at java.lang.reflect.Method.invoke(Method.java:606)rn at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:106)rn at com.sun.proxy.$Proxy23.get_table(Unknown Source)
hive报错
MismatchedTokenException(-1!=105) at org.antlr.runtime.BaseRecognizer.recoverFromMismatchedToken(BaseRecognizer.java:617) at org.antlr.runtime.BaseRecognizer.match(BaseRecognizer.java:115) at org.apac...
使用eclipse连接hive成功,load数据出现MoveTask问题
public class hiveServer2 rn public static class HiveJdbcClient rn rn //private static String driverName = "org.apache.hadoop.hive.jdbc.HiveDriver"; rn private static final String driverName = "org.apache.hive.jdbc.HiveDriver"; rn private static final String url = "jdbc:hive2://192.168.12.10:10000/default"; rn private static final String user = "hive"; rn private static final String password = "hive"; rn private static String sql; rn private static ResultSet res; rn private final static Logger log = Logger.getLogger(HiveJdbcClient.class); rn rn public static void main(String[] args) rn try rn Class.forName(driverName); rn Connection conn = DriverManager.getConnection(url, user, password); rn // 默认使用端口10000, 使用数据库default,用户名为hive,密码为hive rn // Connection conn = DriverManager.getConnection( rn // "jdbc:hive://192.168.12.10:10000/defaultrn Statement stmt = conn.createStatement(); rn rn sql = " load data inpath '/test/table/test1/part-m-00000' INTO TABLE test1 partition(dt='20160000')";//load数据rn System.out.println("Running:" + sql); rn res = stmt.executeQuery(sql); rn System.out.println("执行结果:"); rn while (res.next()) rn System.out.println(res.getString(1)); rn rn rn conn.close(); rn conn = null; rn catch (ClassNotFoundException e) rn e.printStackTrace(); rn log.error(driverName + " not found!", e); rn System.exit(1); rn catch (SQLException e) rn e.printStackTrace(); rn log.error("Connection error!", e); rn System.exit(1); rn rn rn rn rnrn报错:rnjava.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTaskrn at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:283)rn at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:378)rn at com.ssmhbase.sample.hiveServer2$HiveJdbcClient.main(hiveServer2.java:34)rn17:57:47.384 [main] ERROR com.ssmhbase.sample.hiveServer2$HiveJdbcClient - Connection error!rnjava.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTaskrn at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:283) ~[hive-jdbc-2.0.0.jar:2.0.0]rn at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:378) ~[hive-jdbc-2.0.0.jar:2.0.0]rn at com.ssmhbase.sample.hiveServer2$HiveJdbcClient.main(hiveServer2.java:34) [classes/:?]rn代码测试没错误,换成别的sql比如建表语句,insert语句,都正常rn一换成load语句就报错,但是把load语句的sql粘到hive里直接运行,一切正常,这是什么问题啊?
Hive报错
Logging initialized using configuration in jar:file:/cloud/apache-hive-0.13.0-bin/lib/hive-common-0.13.0.jar!/hive-log4j.properties Exception in thread "main" java.lang.RuntimeException: java.lang.Ru
Hive 报错
set hive.auto.convert.join=true; set hive.optimize.skewjoin=true; 这两个参数是用于优化数据倾斜的,但是也是会有问题 ClassCastException org.apache.hadoop.hive.ql.exec.ConditionalTask cannot be cast to org.apache.hadoop.hive....
hive 报错
这是 查询的sqlrnselect * from u1basetmp a join u1base b on (a.c1=b.c1); rnrn rnTotal MapReduce jobs = 1rn14/02/27 15:07:01 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.rnExecution log at: /tmp/mark/.logrn2014-02-27 03:07:01 Starting to launch local task to process map join; maximum memory = 1013645312rn2014-02-27 03:07:02 Dump the side-table into file: file:/tmp/mark/hive_2014-02-27_15-06-58_474_3238300122120331855-1/-local-10002/HashTable-Stage-3/MapJoin-mapfile00--.hashtablern2014-02-27 03:07:02 Upload 1 File to: file:/tmp/mark/hive_2014-02-27_15-06-58_474_3238300122120331855-1/-local-10002/HashTable-Stage-3/MapJoin-mapfile00--.hashtablern2014-02-27 03:07:02 End of local task; Time Taken: 1.108 sec.rnExecution completed successfullyrnMapred Local Task Succeeded . Convert the Join into MapJoinrnMapred Local Task Succeeded . Convert the Join into MapJoinrnLaunching Job 1 out of 1rnNumber of reduce tasks is set to 0 since there's no reduce operatorrnStarting Job = job_201402270955_0005, Tracking URL = http://master130:50030/jobdetails.jsp?jobid=job_201402270955_0005rnKill Command = /home/mark/hadoop/libexec/../bin/hadoop job -kill job_201402270955_0005rn
jdbc执行带返回参数的存储过程报错
jdbc连接mssqlserver2000rn在sqlserver中定义:rnCREATE PROCEDURE test rn@RowCount int OUTPUT rnASrnselect EmployeeID, LastName, FirstName from employees where EmployeeID < 4rnselect @RowCount = count(*) from employees where EmployeeID < 4rnGOrn在java中:rnString driverName = "com.microsoft.jdbc.sqlserver.SQLServerDriver";rnString dbUrl = "jdbc:microsoft:sqlserver://192.168.5.190:1433;databasename=Northwind";rnString userName = "sa";rnString password = "sa";rnConnection dbConn;rnCallableStatement cStatement;rntryrn rn Class.forName(driverName);rn dbConn = DriverManager.getConnection(dbUrl, userName, password);rn cStatement = dbConn.prepareCall("CALL test(?)");rn cStatement.registerOutParameter(1, java.sql.Types.INTEGER);rn ResultSet rs = cStatement.executeQuery();rn int rowCount = rs.getInt(1); rnrncatch.....rn程序执行到 int rowCount = rs.GetInt(1);时报错:rnjava.sql.SQLException: [Microsoft][SQLServer 2000 Driver for JDBC]Invalid operation for the current cursor position.rn不知为什么,请指教
通过JDBC驱动执行sql语句报错
语句如下:rnselect * from dbo.getAllProcList('') as a where procname in ('任务单流程','委托单流程')rn and (exists (select consignid from view_consignProduct b where b.consignid=a.taskid and proid='PR0000003')or exists (select taskid from view_TaskProduct c where a.taskid=c.taskid and pid='PR0000003'))rnrn其中dbo.getAllProcList('')是一个函数,返回一个表rnrn这个语句在查询分析器中可以执行返回结果,但在程序中通过JDBC驱动访问数据库执行就报错“列前缀 'a' 与查询中所用的表名或别名不匹配”,请问微软的jdbc驱动是否有bug
beeline执行sql报错,而hive执行sql正常
[img=https://img-bbs.csdn.net/upload/201705/22/1495453841_564383.png][/img]rn如图,hbase、hive执行命令正常;beeline执行show databases;和show tables;正常,但是执行SQL报错rnPython通过impyla执行SQL也报同样的错误,还望各位前辈指点迷津。
eclipse远程连接Hive(JDBC)
背景:hadoop分布式框架搭建服务器,现在要通过windows端远程连接Hive。 准备: 1. 安装好hadoop框架 2. 安装好hive并测试完成 3. 启动hadoop 一、 打开hiveserver2端口 二、新建java工程 三、测试链接 四、问题 五、一点心得 一、 打开hiveserver2端口 hive --service hive
jdbc连接hive
本代码中demo讲解了如果使用jdbc连接cdh搭建的hive环境信息
impala jdbc hive
impala jdbc hive只要新建 DriverManager 并将 Impala的JDBC Jar包加载进来就可以 这个方法也可以应用于其他支持JDBC连接的数据库,如Hive等
大数据系列hive——jdbc
目录 一、简介 二、HiveServer2 配置 启动 三、Beeline 四、错误处理 五、代码 一、简介        hive可以通过命令行执行hql,它也提供了相应的jdbc驱动,从而可以使用jdbc api进行代码的编写。 二、HiveServer2        hive的服务,只有开启了hiveServer2,客户端才能通过jdbc连接上hive 配置 ...
hive访问JDBC
本课程课程内容突出实战。
jdbc连接hive的问题
利用hive jdbc连接hive出现如下问题:   org.apache.hive.jdbc.HiveDriverorg.apache.hive.jdbc.HiveDriverhive_driver: org.apache.hive.jdbc.HiveDriverhive_url:jdbc:hive2://10.174.242.28:10000/defaultget connection
使用JDBC操作Hive
首先启动 Hive 的远程服务:hiveserver2 &amp;amp; 所需 jar 包的 pom 文件如下: &amp;lt;dependencies&amp;gt; &amp;lt;dependency&amp;gt; &amp;lt;groupId&amp;gt;org.apache.hive&amp;lt;/groupId&amp;gt; &amp;lt;artifactId&amp;gt;hive-jdbc&amp;lt;/artifactId&amp;gt; &amp;
jdbc连接hive的jar包
亲测有用,在ambari2.5.2下安装的hadoop版本,后面的版本应该都没问题
jdbc hive相关jar包
利用 jdbc 连接hive需要的相关jar包 一共17个
hive jdbc cdh
包含hive-jdbc-standalone.jar;hive-jdbc-1.1.0-cdh5.10.0-standalone.jar;hive-jdbc-1.1.0-cdh5.10.0.jar;hive-jdbc.jar
jdbc连接hive工具类
使用jdbc连接hive 里面提供了很多封装方法 .....................................................................
hive jdbc程序开发
本文主要向大家介绍hive2.0的jdbc程序开发。 前提条件 hive的hiveserver2可正常工作。 验证方法 进入hive的bin目录执行./hiveserver2命令通过客户机使用telnet hive_ip 10000命令检查hiveserver2是否可进行连接。 开发环境 hive2.0.0+hadoop2.7.1JDK1.7maven2 mave
Jdbc连接Hive数据库
Jdbc连接Hive数据库通常会遇到:     报错:jdbc:hive2://master0.example.com:10000: Java.NET.ConnectException: Connection refused: connect 首先来看下maven的配置文件: 接着是hive-site.xml文件:    
Hive:JDBC示例
1)本地目录/home/hadoop/test下的test4.txt文件内容(每行数据之间用tab键隔开)如下所示: [hadoop@master test]$ sudo vim test4.txt 1 dajiangtai 2 hadoop 3 hive 4 hbase 5 spark 2)启动hiveserver2 [hadoop@master t...
Hive JDBC实践V1-Part1-JDBC-Config
1.Hive系统概述2.Hive安装与配置 3.Hive数据模型4.Hive HQL5.Hive 常见函数6.Hive 自定义函数 7.Hive2.0存储过程:HPL/SQL实践 8.Hive Index 原理及使用 9.Hive Update,Delete 操作说明 10.Hive ORCFile,Parquet文件格式实践 11.Hive 数据压缩及解决数据倾斜问题12.Hive JDBC实践
通过JDBC连接Hive
使用JDBC去操作hive可能是程序员们比较喜欢的一种方式,今天来总结一下使用java api来对hive进行增删查改,这里我主要演示对hive表中数据的操作,不创建表已经改变表原有的结构。本文基于hive已经能正常使用的情况。 首先hive必须以服务方式启动,平台默认启动时hive server2 模式。hiveserver2是比hiveserver更高级的服务模式,提供了hiveserver...
开发hive JDBC
开发hive JDBC开发的步骤!!!!
相关热词 c#入门推荐书 c# 解码海康数据流 c# xml的遍历循环 c# 取 查看源码没有的 c#解决高并发 委托 c#日期转化为字符串 c# 显示问号 c# 字典对象池 c#5.0 安装程序 c# 分页算法