赤兮丷 2022-02-24 15:51
浏览 17
已结题

flume采集数据保存hive报错,如何解决?


2022-02-24 07:48:20,768 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.hive.HiveSink.getOrCreateWriter(HiveSink.java:344)] k1: Creating Writer to Hive end point : {metaStoreUri='thrift://hive:9083', database='nineties', table='tsaaa_user', partitionVals=[] }
2022-02-24 07:48:21,745 (hive-k1-call-runner-0) [INFO - org.apache.hive.hcatalog.common.HiveClientCache.<init>(HiveClientCache.java:119)] Initializing cache: eviction-timeout=120 initial-capacity=50 maximum-capacity=50
Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.VerifyError: Stack map does not match the one at exception handler 307
Exception Details:
  Location:
    org/apache/hive/hcatalog/streaming/AbstractRecordWriter.<init>(Lorg/apache/hive/hcatalog/streaming/HiveEndPoint;Lorg/apache/hadoop/hive/conf/HiveConf;Lorg/apache/hive/hcatalog/streaming/StreamingConnection;)V @307: astore
  Reason:
    Type 'org/apache/hadoop/hive/metastore/api/MetaException' (current frame, stack[0]) is not assignable to 'org/apache/thrift/TException' (stack map, stack[0])
  Current Frame:
    bci: @38
    flags: { }
    locals: { 'org/apache/hive/hcatalog/streaming/AbstractRecordWriter', 'org/apache/hive/hcatalog/streaming/HiveEndPoint', 'org/apache/hadoop/hive/conf/HiveConf', 'org/apache/hive/hcatalog/streaming/StreamingConnection' }
    stack: { 'org/apache/hadoop/hive/metastore/api/MetaException' }
  Stackmap Frame:
    bci: @307
    flags: { }
    locals: { 'org/apache/hive/hcatalog/streaming/AbstractRecordWriter', 'org/apache/hive/hcatalog/streaming/HiveEndPoint', 'org/apache/hadoop/hive/conf/HiveConf', 'org/apache/hive/hcatalog/streaming/StreamingConnection' }
    stack: { 'org/apache/thrift/TException' }
  Bytecode:
    0x0000000: 2ab7 0005 2a01 b500 062a 2bb5 0003 2a2c
    0x0000010: c600 072c a700 0f12 072a b400 03b4 0008
    0x0000020: b800 09b5 000a 2a2a b400 0ab8 000b b500
    0x0000030: 022d c600 0c2d b900 0c01 00a7 0004 013a
    0x0000040: 0419 04c7 0031 2a2a b400 022a b400 03b4
    0x0000050: 000d 2ab4 0003 b400 0eb9 000f 0300 b500
    0x0000060: 102a 2a2a b400 022a b400 03b7 0001 b500
    0x0000070: 11a7 0027 1904 bb00 1259 2ab7 0013 b600
    0x0000080: 14c0 0015 3a05 2a19 05b8 0016 b500 102a
    0x0000090: 1905 b800 17b5 0011 2a2a b400 10b6 0018
    0x00000a0: b600 199e 0007 04a7 0004 03b5 001a 2a2a
    0x00000b0: b400 1a99 0010 2ab4 0010 b600 18b6 0019
    0x00000c0: a700 0404 b500 1b2a b400 1a99 0032 2a2a
    0x00000d0: 2ab4 0010 b600 18b6 001c 2ab4 0010 b600
    0x00000e0: 18b6 001d b700 1eb5 001f 2a2a b400 1fb9
    0x00000f0: 0020 0100 bd00 21b5 0022 a700 0a2a b800
    0x0000100: 23b5 001f 2ab4 0010 b600 18b6 0024 3a05
    0x0000110: 2a19 05b8 0025 2cb8 0026 c000 27b5 0028
    0x0000120: a700 313a 04bb 002a 592b b600 2b19 04b7
    0x0000130: 002c bf3a 04bb 002f 592b 1904 b700 30bf
    0x0000140: 3a04 bb00 2a59 1904 b600 3419 04b7 002c
    0x0000150: bfb1                                   
  Exception Handler Table:
    bci [38, 288] => handler: 291
    bci [38, 288] => handler: 307
    bci [38, 288] => handler: 307
    bci [38, 288] => handler: 320
    bci [38, 288] => handler: 320
    bci [38, 288] => handler: 320
  Stackmap Table:
    full_frame(@23,{Object[#206],Object[#207],Object[#208],Object[#209]},{Object[#206]})
    full_frame(@35,{Object[#206],Object[#207],Object[#208],Object[#209]},{Object[#206],Object[#208]})
    same_frame(@62)
    same_locals_1_stack_item_frame(@63,Object[#210])
    append_frame(@116,Object[#210])
    same_frame(@152)
    same_locals_1_stack_item_frame(@170,Object[#206])
    full_frame(@171,{Object[#206],Object[#207],Object[#208],Object[#209],Object[#210]},{Object[#206],Integer})
    same_locals_1_stack_item_frame(@195,Object[#206])
    full_frame(@196,{Object[#206],Object[#207],Object[#208],Object[#209],Object[#210]},{Object[#206],Integer})
    same_frame(@253)
    same_frame(@260)
    full_frame(@291,{Object[#206],Object[#207],Object[#208],Object[#209]},{Object[#211]})
    same_locals_1_stack_item_frame(@307,Object[#212])
    same_locals_1_stack_item_frame(@320,Object[#213])
    same_frame(@337)

        at org.apache.flume.sink.hive.HiveJsonSerializer.createRecordWriter(HiveJsonSerializer.java:54)
        at org.apache.flume.sink.hive.HiveWriter.<init>(HiveWriter.java:89)
        at org.apache.flume.sink.hive.HiveSink.getOrCreateWriter(HiveSink.java:346)
        at org.apache.flume.sink.hive.HiveSink.drainOneBatch(HiveSink.java:297)
        at org.apache.flume.sink.hive.HiveSink.process(HiveSink.java:254)
        at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
        at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
        at java.lang.Thread.run(Thread.java:750)
  • 写回答

0条回答 默认 最新

    报告相同问题?

    问题事件

    • 系统已结题 3月4日
    • 创建了问题 2月24日

    悬赏问题

    • ¥15 两台交换机分别是trunk接口和access接口为何无法通信,通信过程是如何?
    • ¥15 C语言使用vscode编码错误
    • ¥15 用KSV5转成本时,如何不生成那笔中间凭证
    • ¥20 ensp怎么配置让PC1和PC2通讯上
    • ¥50 有没有适合匹配类似图中的运动规律的图像处理算法
    • ¥15 dnat基础问题,本机发出,别人返回的包,不能命中
    • ¥15 请各位帮我看看是哪里出了问题
    • ¥15 vs2019的js智能提示
    • ¥15 关于#开发语言#的问题:FDTD建模问题图中代码没有报错,但是模型却变透明了
    • ¥15 uniapp的h5项目写一个抽奖动画