多线程调用DATAX,执行四个JSON文件,结果四个job同时结束,后台查数据,只有一个job执行结束了,另外3个数据还没同步完就停了,想问下这是什么问题。
#datax
DATAX多线程调用,结果同时结束了的问题
- 写回答
- 好问题 0 提建议
- 追加酬金
- 关注问题
- 邀请回答
-
1条回答 默认 最新
关注 【相关推荐】
- 这篇博客: 数据同步工具datax中的 3.编写job的json文件 部分也许能够解决你的问题, 你可以仔细阅读以下内容或跳转源博客中阅读:
#mysql -> postgresql { "job": { "content": [ { "reader": { "name": "mysqlreader", "parameter": { "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"], "connection": [ { "jdbcUrl": ["jdbc:mysql://10.1.1.184:3306/nrd_server_dev?allowMultiQueries=true&useUnicode=true&characterEncoding=UTF-8"], "table": ["action_log"] } ], "password": "root", "username": "root", "where": "tenant_id is not null and tenant_id <> 0 and create_tm > \'${startTm}\' and create_tm <= \'${endTm}\' " } }, "writer": { "name": "postgresqlwriter", "parameter": { "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"], "connection": [ { "jdbcUrl": "jdbc:postgresql://192.168.88.170:5432/datax", "table": ["\"model1\".\"action_log\""] } ], "password": "123456", "postSql": [], "preSql": [], "username": "postgres" } } } ], "setting": { "speed": { "channel": "3" } } } } #mysql -> mpp { "job": { "content": [ { "reader": { "name": "mysqlreader", "parameter": { "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"], "connection": [ { "jdbcUrl": ["jdbc:mysql://10.1.1.184:3306/nrd_server_dev?allowMultiQueries=true&useUnicode=true&characterEncoding=UTF-8"], "table": ["action_log"] } ], "password": "root", "username": "root", "where": "" } }, "writer": { "name": "postgresqlwriter", "parameter": { "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"], "connection": [ { "jdbcUrl": "jdbc:postgresql://220.194.43.5:5432/test", "table": ["\"datax_test\".\"action_log\""] } ], "password": "123456", "preSql": [], "postSql": [], "username": "test" } } } ], "setting": { "speed": { "channel": "3" } } } }
如果你已经解决了该问题, 非常希望你能够分享一下解决方案, 写成博客, 将相关链接放在评论区, 以帮助更多的人 ^-^解决评论 打赏 举报无用 1- 这篇博客: 数据同步工具datax中的 3.编写job的json文件 部分也许能够解决你的问题, 你可以仔细阅读以下内容或跳转源博客中阅读:
悬赏问题
- ¥15 如何让企业微信机器人实现消息汇总整合
- ¥50 关于#ui#的问题:做yolov8的ui界面出现的问题
- ¥15 如何用Python爬取各高校教师公开的教育和工作经历
- ¥15 TLE9879QXA40 电机驱动
- ¥20 对于工程问题的非线性数学模型进行线性化
- ¥15 Mirare PLUS 进行密钥认证?(详解)
- ¥15 物体双站RCS和其组成阵列后的双站RCS关系验证
- ¥20 想用ollama做一个自己的AI数据库
- ¥15 关于qualoth编辑及缝合服装领子的问题解决方案探寻
- ¥15 请问怎么才能复现这样的图呀