flywong1 2021-07-15 18:19 采纳率: 0%
浏览 816

spark插入doris报错 failed to init delta writer

sparksql处理数据后入到doris,但是无论开多少个executor都会报这样的错误,请问如何解决???failed to init delta writer. version count: 502, exceed limit: 500

看到论坛说降低doris的插入速度,插入速度如何降低啊,没找到答案,我正常入mysql都没事的,doris却不行!

W0715 17:41:28.268887 26304 delta_writer.cpp:106] failed to init delta writer. version count: 502, exceed limit: 500. tablet: 151155.206293714.ec469b875f17f928-ac90e869de9deba1
W0715 17:41:28.269280 26337 tablet_sink.cpp:167] NodeChannel[137464-10004] add batch req success but status isn't ok, load_id=70130da5e5f74fa5-9081e82d2775beb5, txn_id=394640, node=202.102.90.24:8060, errmsg=tablet writer write failed, tablet_id=151155, txn_id=394640, err=-215
W0715 17:41:28.269441 26345 tablet_sink.cpp:167] NodeChannel[137464-10003] add batch req success but status isn't ok, load_id=70130da5e5f74fa5-9081e82d2775beb5, txn_id=394640, node=202.102.90.23:8060, errmsg=tablet writer write failed, tablet_id=151155, txn_id=394640, err=-215
W0715 17:41:28.269786 26195 tablet_sink.cpp:728] NodeChannel[137464-10004]: close channel failed, load_id=70130da5e5f74fa5-9081e82d2775beb5, txn_id=394640. error_msg=close wait failed coz rpc error
W0715 17:41:28.302212 26304 tablets_channel.cpp:117] tablet writer write failed, tablet_id=151155, txn_id=394640, err=-215
W0715 17:41:28.302374 26304 internal_service.cpp:105] tablet writer add batch failed, message=tablet writer write failed, tablet_id=151155, txn_id=394640, err=-215, id=70130da5e5f74fa5-9081e82d2775beb5, index_id=137464, sender_id=0
W0715 17:41:28.302485 26313 tablet_sink.cpp:167] NodeChannel[137464-10002] add batch req success but status isn't ok, load_id=70130da5e5f74fa5-9081e82d2775beb5, txn_id=394640, node=202.102.90.25:8060, errmsg=tablet writer write failed, tablet_id=151155, txn_id=394640, err=-215
W0715 17:41:28.303449 26195 tablet_sink.cpp:728] NodeChannel[137464-10002]: close channel failed, load_id=70130da5e5f74fa5-9081e82d2775beb5, txn_id=394640. error_msg=close wait failed coz rpc error. node=202.102.90.25:8060, errmsg=tablet writer write failed, tablet_id=151155, txn_id=394640, err=-215
W0715 17:41:28.303469 26195 tablet_sink.cpp:728] NodeChannel[137464-10003]: close channel failed, load_id=70130da5e5f74fa5-9081e82d2775beb5, txn_id=394640. error_msg=already stopped, skip waiting for close. cancelled/!eos: : 1/0

  • 写回答

1条回答 默认 最新

  • 咕泡-星云 2021-08-12 16:39
    关注

    可能和doris本身有关,可参考: http://ai.baidu.com/forum/topic/show/988653 http://ai.baidu.com/forum/topic/show/988653
    如有帮助,望及时采纳

    评论

报告相同问题?

问题事件

  • 创建了问题 7月15日

悬赏问题

  • ¥15 使用ue5插件narrative时如何切换关卡也保存叙事任务记录
  • ¥20 软件测试决策法疑问求解答
  • ¥15 win11 23H2删除推荐的项目,支持注册表等
  • ¥15 matlab 用yalmip搭建模型,cplex求解,线性化处理的方法
  • ¥15 qt6.6.3 基于百度云的语音识别 不会改
  • ¥15 关于#目标检测#的问题:大概就是类似后台自动检测某下架商品的库存,在他监测到该商品上架并且可以购买的瞬间点击立即购买下单
  • ¥15 神经网络怎么把隐含层变量融合到损失函数中?
  • ¥15 lingo18勾选global solver求解使用的算法
  • ¥15 全部备份安卓app数据包括密码,可以复制到另一手机上运行
  • ¥20 测距传感器数据手册i2c