Isay_me 2021-03-11 11:17 采纳率: 0%
浏览 837

kettle抽取hive数据,数据输出到clickhouse中报错

2021/03/11 09:24:16 - Table output.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Because of an error, this step can't continue:
2021/03/11 09:24:16 - Table output.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : org.pentaho.di.core.exception.KettleException: 
2021/03/11 09:24:16 - Table output.0 - Error inserting row into table [DIM_SKU_TEST] with values: [10000759]
2021/03/11 09:24:16 - Table output.0 - 
2021/03/11 09:24:16 - Table output.0 - offending row : [SKU_SK String(2147483647)]
2021/03/11 09:24:16 - Table output.0 - 
2021/03/11 09:24:16 - Table output.0 - Error setting value #1 [String(2147483647)] on prepared statement
2021/03/11 09:24:16 - Table output.0 -  at java.lang.Thread.run (null:-1)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow (TableOutput.java:125)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable (TableOutput.java:261)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.core.database.Database.setValues (Database.java:1076)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.core.database.Database.setValue (Database.java:1060)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue (ValueMetaBase.java:5042)
2021/03/11 09:24:16 - Table output.0 -  at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream (ClickHousePreparedStatementImpl.java:416)
2021/03/11 09:24:16 - Table output.0 - 
2021/03/11 09:24:16 - Table output.0 - 
2021/03/11 09:24:16 - Table output.0 - 
2021/03/11 09:24:16 - Table output.0 -     at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:385)
2021/03/11 09:24:16 - Table output.0 -     at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:125)
2021/03/11 09:24:16 - Table output.0 -     at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2021/03/11 09:24:16 - Table output.0 -     at java.lang.Thread.run(Unknown Source)
2021/03/11 09:24:16 - Table output.0 - Caused by: org.pentaho.di.core.exception.KettleDatabaseException: 
2021/03/11 09:24:16 - Table output.0 - offending row : [SKU_SK String(2147483647)]
2021/03/11 09:24:16 - Table output.0 - 
2021/03/11 09:24:16 - Table output.0 - Error setting value #1 [String(2147483647)] on prepared statement
2021/03/11 09:24:16 - Table output.0 -  at java.lang.Thread.run (null:-1)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow (TableOutput.java:125)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable (TableOutput.java:261)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.core.database.Database.setValues (Database.java:1076)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.core.database.Database.setValue (Database.java:1060)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue (ValueMetaBase.java:5042)
2021/03/11 09:24:16 - Table output.0 -  at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream (ClickHousePreparedStatementImpl.java:416)
2021/03/11 09:24:16 - Table output.0 - 
2021/03/11 09:24:16 - Table output.0 - 
2021/03/11 09:24:16 - Table output.0 -     at org.pentaho.di.core.database.Database.setValues(Database.java:1078)
2021/03/11 09:24:16 - Table output.0 -     at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:261)
2021/03/11 09:24:16 - Table output.0 -     ... 3 more
2021/03/11 09:24:16 - Table output.0 - Caused by: org.pentaho.di.core.exception.KettleDatabaseException: 
2021/03/11 09:24:16 - Table output.0 - Error setting value #1 [String(2147483647)] on prepared statement
2021/03/11 09:24:16 - Table output.0 -  at java.lang.Thread.run (null:-1)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow (TableOutput.java:125)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable (TableOutput.java:261)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.core.database.Database.setValues (Database.java:1076)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.core.database.Database.setValue (Database.java:1060)
2021/03/11 09:24:16 - Table output.0 -  at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue (ValueMetaBase.java:5042)
2021/03/11 09:24:16 - Table output.0 -  at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream (ClickHousePreparedStatementImpl.java:416)
2021/03/11 09:24:16 - Table output.0 - 
2021/03/11 09:24:16 - Table output.0 -     at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue(ValueMetaBase.java:5128)
2021/03/11 09:24:16 - Table output.0 -     at org.pentaho.di.core.database.Database.setValue(Database.java:1060)
2021/03/11 09:24:16 - Table output.0 -     at org.pentaho.di.core.database.Database.setValues(Database.java:1076)
2021/03/11 09:24:16 - Table output.0 -     ... 4 more
2021/03/11 09:24:16 - Table output.0 - Caused by: java.sql.SQLFeatureNotSupportedException
2021/03/11 09:24:16 - Table output.0 -     at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream(ClickHousePreparedStatementImpl.java:416)
2021/03/11 09:24:16 - Table output.0 -     at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue(ValueMetaBase.java:5042)
2021/03/11 09:24:16 - Table output.0 -     ... 6 more
2021/03/11 09:24:16 - test1 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Something went wrong while trying to stop the transformation: org.pentaho.di.core.exception.KettleDatabaseException: 
2021/03/11 09:24:16 - test1 - Error cancelling statement
2021/03/11 09:24:16 - test1 - Invalid OperationHandle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=eeb764fc-e057-4349-b8d9-8ac02cc52ff4]
2021/03/11 09:24:16 - test1 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : org.pentaho.di.core.exception.KettleDatabaseException: 
2021/03/11 09:24:16 - test1 - Error cancelling statement
2021/03/11 09:24:16 - test1 - Invalid OperationHandle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=eeb764fc-e057-4349-b8d9-8ac02cc52ff4]
2021/03/11 09:24:16 - test1 - 
2021/03/11 09:24:16 - test1 -     at org.pentaho.di.core.database.Database.cancelStatement(Database.java:750)
2021/03/11 09:24:16 - test1 -     at org.pentaho.di.core.database.Database.cancelQuery(Database.java:732)
2021/03/11 09:24:16 - test1 -     at org.pentaho.di.trans.steps.tableinput.TableInput.stopRunning(TableInput.java:299)
2021/03/11 09:24:16 - test1 -     at org.pentaho.di.trans.Trans.stopAll(Trans.java:1889)
2021/03/11 09:24:16 - test1 -     at org.pentaho.di.trans.step.BaseStep.stopAll(BaseStep.java:2915)
2021/03/11 09:24:16 - test1 -     at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:139)
2021/03/11 09:24:16 - test1 -     at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2021/03/11 09:24:16 - test1 -     at java.lang.Thread.run(Unknown Source)
2021/03/11 09:24:16 - test1 - Caused by: org.apache.hive.service.cli.HiveSQLException: Invalid OperationHandle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=eeb764fc-e057-4349-b8d9-8ac02cc52ff4]
2021/03/11 09:24:16 - test1 -     at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:241)
2021/03/11 09:24:16 - test1 -     at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:227)
2021/03/11 09:24:16 - test1 -     at org.apache.hive.jdbc.HiveStatement.cancel(HiveStatement.java:152)
2021/03/11 09:24:16 - test1 -     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021/03/11 09:24:16 - test1 -     at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
2021/03/11 09:24:16 - test1 -     at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
2021/03/11 09:24:16 - test1 -     at java.lang.reflect.Method.invoke(Unknown Source)
2021/03/11 09:24:16 - test1 -     at org.pentaho.hadoop.shim.common.invocationhandler.CaptureResultSetInvocationHandler.invoke(CaptureResultSetInvocationHandler.java:115)
2021/03/11 09:24:16 - test1 -     at com.sun.proxy.$Proxy74.cancel(Unknown Source)
2021/03/11 09:24:16 - test1 -     at org.pentaho.di.core.database.Database.cancelStatement(Database.java:744)
2021/03/11 09:24:16 - test1 -     ... 7 more
2021/03/11 09:24:16 - test1 - Caused by: org.apache.hive.service.cli.HiveSQLException: Invalid OperationHandle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=eeb764fc-e057-4349-b8d9-8ac02cc52ff4]
2021/03/11 09:24:16 - test1 -     at org.apache.hive.service.cli.operation.OperationManager.getOperation(OperationManager.java:177)
2021/03/11 09:24:16 - test1 -     at org.apache.hive.service.cli.CLIService.cancelOperation(CLIService.java:421)
2021/03/11 09:24:16 - test1 -     at org.apache.hive.service.cli.thrift.ThriftCLIService.CancelOperation(ThriftCLIService.java:655)
2021/03/11 09:24:16 - test1 -     at org.apache.hive.service.cli.thrift.TCLIService$Processor$CancelOperation.getResult(TCLIService.java:1493)
2021/03/11 09:24:16 - test1 -     at org.apache.hive.service.cli.thrift.TCLIService$Processor$CancelOperation.getResult(TCLIService.java:1478)
2021/03/11 09:24:16 - test1 -     at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
2021/03/11 09:24:16 - test1 -     at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
2021/03/11 09:24:16 - test1 -     at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
2021/03/11 09:24:16 - test1 -     at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
2021/03/11 09:24:16 - test1 -     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2021/03/11 09:24:16 - test1 -     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2021/03/11 09:24:16 - test1 -     at java.lang.Thread.run(Thread.java:748)
2021/03/11 09:24:16 - Table output.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=1)
2021/03/11 09:24:16 - test1 - Transformation detected one or more steps with errors.
2021/03/11 09:24:16 - test1 - Transformation is killing the other steps!
2021/03/11 09:24:16 - Table input.0 - Finished processing (I=100, O=0, R=0, W=100, U=0, E=0)
2021/03/11 09:24:16 - test1 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Errors detected!
2021/03/11 09:24:16 - Spoon - The transformation has finished!!
2021/03/11 09:24:16 - test1 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Errors detected!

2021/03/11 09:24:16 - test1 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Errors detected!

  • 写回答

2条回答 默认 最新

  • 有问必答小助手 2021-03-11 14:20
    关注

    你好,我是问答小助手。为了技术专家团可以更好地为您解答问题,烦请您补充下(1)问题背景详情,(2)您想解决的具体问题,(3)相关图片,便于技术专家团更好地理解问题,并给出解决方案。

    评论

报告相同问题?

悬赏问题

  • ¥15 请问我该如何添加自己的数据去运行蚁群算法代码
  • ¥20 用HslCommunication 连接欧姆龙 plc有时会连接失败。报异常为“未知错误”
  • ¥15 网络设备配置与管理这个该怎么弄
  • ¥20 机器学习能否像多层线性模型一样处理嵌套数据
  • ¥20 西门子S7-Graph,S7-300,梯形图
  • ¥50 用易语言http 访问不了网页
  • ¥50 safari浏览器fetch提交数据后数据丢失问题
  • ¥15 matlab不知道怎么改,求解答!!
  • ¥15 永磁直线电机的电流环pi调不出来
  • ¥15 用stata实现聚类的代码