笨笨熊zzc 2023-08-07 17:32 采纳率: 0%
浏览 5

DATAX多线程调用,结果同时结束了的问题

多线程调用DATAX,执行四个JSON文件,结果四个job同时结束,后台查数据,只有一个job执行结束了,另外3个数据还没同步完就停了,想问下这是什么问题。
#datax

  • 写回答

1条回答 默认 最新

  • CSDN-Ada助手 CSDN-AI 官方账号 2023-08-07 23:49
    关注

    【相关推荐】



    • 这篇博客: 数据同步工具datax中的 3.编写job的json文件 部分也许能够解决你的问题, 你可以仔细阅读以下内容或跳转源博客中阅读:
      #mysql -> postgresql
      {
          "job": {
              "content": [
                  {
                      "reader": {	
                          "name": "mysqlreader", 			 
                          "parameter": {		
                              "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"], 
                              "connection": [
                                  {
                                      "jdbcUrl": ["jdbc:mysql://10.1.1.184:3306/nrd_server_dev?allowMultiQueries=true&useUnicode=true&characterEncoding=UTF-8"], 
                                      "table": ["action_log"]
                                  }
                              ], 
                              "password": "root", 
                              "username": "root", 
                              "where": "tenant_id is not null and tenant_id <> 0 and create_tm > \'${startTm}\' and create_tm <= \'${endTm}\' "
                          }
                      }, 
                      "writer": {
                          "name": "postgresqlwriter", 
                          "parameter": {
                              "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"],
                              "connection": [
                                  {
                                      "jdbcUrl": "jdbc:postgresql://192.168.88.170:5432/datax", 
                                      "table": ["\"model1\".\"action_log\""]
                                  }
                              ], 
                              "password": "123456", 
                              "postSql": [], 
                              "preSql": [], 
                              "username": "postgres"
                          }
                      }
                  }
              ], 
              "setting": {
                  "speed": {
                      "channel": "3" 
                  }
              }
          }
      }
      
      
      #mysql -> mpp
      
      {
          "job": {
              "content": [
                  {
                      "reader": {	
                          "name": "mysqlreader", 			 
                          "parameter": {		
                              "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"], 
                              "connection": [
                                  {
                                      "jdbcUrl": ["jdbc:mysql://10.1.1.184:3306/nrd_server_dev?allowMultiQueries=true&useUnicode=true&characterEncoding=UTF-8"], 
                                      "table": ["action_log"]
                                  }
                              ], 
                              "password": "root", 
                              "username": "root", 
                              "where": ""
                          }
                      }, 
                      "writer": {
                          "name": "postgresqlwriter", 
                          "parameter": {
                              "column": ["id","operate_model","operate_type","operate_result","creator","modifier","modify_tm","create_tm","tenant_id"],
                              "connection": [
                                  {
                                      "jdbcUrl": "jdbc:postgresql://220.194.43.5:5432/test", 
                                      "table": ["\"datax_test\".\"action_log\""]
                                  }
                              ], 
                              "password": "123456", 
                              "preSql": [], 
                              "postSql": [],     
                              "username": "test"
                          }
                      }
                  }
              ], 
              "setting": {
                  "speed": {
                      "channel": "3" 
                  }
              }
          }
      }
      
      
      
      
      

    如果你已经解决了该问题, 非常希望你能够分享一下解决方案, 写成博客, 将相关链接放在评论区, 以帮助更多的人 ^-^
    评论

报告相同问题?

问题事件

  • 创建了问题 8月7日

悬赏问题

  • ¥15 如何让企业微信机器人实现消息汇总整合
  • ¥50 关于#ui#的问题:做yolov8的ui界面出现的问题
  • ¥15 如何用Python爬取各高校教师公开的教育和工作经历
  • ¥15 TLE9879QXA40 电机驱动
  • ¥20 对于工程问题的非线性数学模型进行线性化
  • ¥15 Mirare PLUS 进行密钥认证?(详解)
  • ¥15 物体双站RCS和其组成阵列后的双站RCS关系验证
  • ¥20 想用ollama做一个自己的AI数据库
  • ¥15 关于qualoth编辑及缝合服装领子的问题解决方案探寻
  • ¥15 请问怎么才能复现这样的图呀