发霉的山竹精 2022-06-10 09:31
浏览 12
已结题

纯钧-logminer到oracle

问题遇到的现象和发生背景

在使用纯钧实时同步数据时,从oracle logminer读取数据,并写入oracle中, 由于各种原因,导致程序无法是是写入,还希望能给予帮助

问题相关代码,请勿粘贴截图

{
"job": {
"content": [
{
"reader": {
"parameter": {
"jdbcUrl": "jdbc:oracle:thin:@192.168.147.128:1521:helowin",
"username": "qyj",
"password": "qyj",
"supportAutoAddLog": false,
"table": ["QYJ.test_01"],
"column": [{
"name": "id",
"type": "string"
},{
"name": "name",
"type": "string"
}],
"cat": "UPDATE,INSERT,DELETE",
"pavingData" : true,
"readPosition" : "CURRENT",
"queryTimeout": 3000
},
"table": {
"tableName": "sourceTable"
},
"name": "oraclelogminerreader"
},
"writer": {
"name": "oraclewriter",
"parameter": {
"mode": "INSERT,DELETE,UPDATE",
"allReplace": true,
"username": "qyj",
"password": "qyj",
"connection": [
{
"schema": "QYJ",
"jdbcUrl": "jdbc:oracle:thin:@192.168.147.128:1521:helowin",
"table": ["test_02"]
}
],
"transformer": {
"transformSql": "select * from QYJ.sourceTable where MOD(id, 2) <> 0"
},
"column": ["id","name"],
"writeMode": "insert",
"updateKey": {"key": ["id"]},
"nameMapping":{
"schemaMappings":{
"QYJ":"QYJ"
},
"tableMappings":{
"QYJ":{
"test_01": "test_02"
}
}
}
}
}
}
],
"setting": {
"speed": {
"channel": 1,
"bytes": 0
},
"errorLimit": {
"record": 1
},
"restore": {
"maxRowNumForCheckpoint": 0,
"isRestore": false,
"restoreColumnName": "",
"restoreColumnIndex": 0
},
"log" : {
"isLogger": false,
"level" : "debug",
"path" : "",
"pattern":""
}
}
}
}

运行结果及报错内容

com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IndexOutOfBoundsException: Index: -1, Size: 2
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2207)
at com.google.common.cache.LocalCache.get(LocalCache.java:3953)
at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4790)
at com.dtstack.chunjun.connector.jdbc.sink.PreparedStmtProxy.getOrCreateFieldNamedPstmt(PreparedStmtProxy.java:151)
at com.dtstack.chunjun.connector.jdbc.sink.PreparedStmtProxy.convertToExternal(PreparedStmtProxy.java:122)
at com.dtstack.chunjun.connector.jdbc.sink.JdbcOutputFormat.writeMultipleRecordsInternal(JdbcOutputFormat.java:215)
at com.dtstack.chunjun.sink.format.BaseRichOutputFormat.writeRecordInternal(BaseRichOutputFormat.java:483)
at com.dtstack.chunjun.sink.format.BaseRichOutputFormat.lambda$initTimingSubmitTask$0(BaseRichOutputFormat.java:443)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset$$$capture(FutureTask.java:308)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.IndexOutOfBoundsException: Index: -1, Size: 2
at java.util.LinkedList.checkElementIndex(LinkedList.java:555)
at java.util.LinkedList.get(LinkedList.java:476)
at com.dtstack.chunjun.connector.jdbc.sink.DynamicPreparedStmt.getColumnMeta(DynamicPreparedStmt.java:240)
at com.dtstack.chunjun.connector.jdbc.sink.DynamicPreparedStmt.buildStmt(DynamicPreparedStmt.java:84)
at com.dtstack.chunjun.connector.jdbc.sink.PreparedStmtProxy.lambda$getOrCreateFieldNamedPstmt$0(PreparedStmtProxy.java:155)
at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4793)
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3542)
at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2323)
at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2286)
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2201)

数据表结构是, test_01 到test_02, 结构一致

  • 写回答

0条回答 默认 最新

    报告相同问题?

    问题事件

    • 系统已结题 6月18日
    • 创建了问题 6月10日

    悬赏问题

    • ¥50 AI大模型精调(百度千帆、飞浆)
    • ¥15 关于#c语言#的问题:我在vscode和codeblocks中编写c语言时出现打不开源文件该怎么办
    • ¥15 非科班怎么跑代码?如何导数据和调参
    • ¥15 福州市的全人群死因监测点死亡原因报表
    • ¥15 Altair EDEM中生成一个颗粒,并且各个方向没有初始速度
    • ¥15 系统2008r2 装机配置推荐一下
    • ¥500 服务器搭建cisco AnyConnect vpn
    • ¥15 悬赏Python-playwright部署在centos7上
    • ¥15 psoc creator软件有没有人能远程安装啊
    • ¥15 快速扫描算法求解Eikonal方程咨询