旭g 2021-03-21 16:34 采纳率: 0%
浏览 168

flume消费kafka到hdfs异常

21/03/21 15:58:20 INFO utils.AppInfoParser: Kafka version : 0.9.0.1
21/03/21 15:58:20 INFO utils.AppInfoParser: Kafka commitId : 23c69d62a0cabf06
21/03/21 15:58:20 INFO utils.AppInfoParser: Kafka version : 0.9.0.1
21/03/21 15:58:20 INFO utils.AppInfoParser: Kafka commitId : 23c69d62a0cabf06
21/03/21 15:58:20 INFO kafka.SourceRebalanceListener: topic topic_event - partition 0 assigned.
21/03/21 15:58:20 INFO kafka.SourceRebalanceListener: topic topic_event - partition 0 revoked.
21/03/21 15:58:21 INFO kafka.KafkaSource: Kafka source r1 started.
21/03/21 15:58:21 INFO instrumentation.MonitoredCounterGroup: Monitored counter group for type: SOURCE, name: r1: Successfully registered new MBean.
21/03/21 15:58:21 INFO instrumentation.MonitoredCounterGroup: Component type: SOURCE, name: r1 started
21/03/21 15:58:24 INFO internals.AbstractCoordinator: Attempt to heart beat failed since the group is rebalancing, try to re-join group.
21/03/21 15:58:24 INFO kafka.SourceRebalanceListener: topic topic_event - partition 0 assigned.
21/03/21 15:58:24 INFO kafka.SourceRebalanceListener: topic topic_start - partition 0 assigned.
21/03/21 15:58:24 INFO kafka.KafkaSource: Kafka source r2 started.
21/03/21 15:58:24 INFO instrumentation.MonitoredCounterGroup: Monitored counter group for type: SOURCE, name: r2: Successfully registered new MBean.
21/03/21 15:58:24 INFO instrumentation.MonitoredCounterGroup: Component type: SOURCE, name: r2 started
21/03/21 15:59:26 ERROR kafka.KafkaSource: KafkaSource EXCEPTION, {}
java.lang.IllegalStateException: Channel closed [channel=c2]. Due to java.lang.NullPointerException: null
    at org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:348)
    at org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:122)
    at org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:183)
    at org.apache.flume.source.kafka.KafkaSource.doProcess(KafkaSource.java:295)
    at org.apache.flume.source.AbstractPollableSource.process(AbstractPollableSource.java:60)
    at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:133)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
    at org.apache.flume.channel.file.Log.writeCheckpoint(Log.java:1061)
    at org.apache.flume.channel.file.Log.replay(Log.java:499)
    at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:298)
    at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:249)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    ... 1 more

  • 写回答

1条回答 默认 最新

  • ricky9777 2021-09-03 16:03
    关注

    同样问题,楼主解决了吗

    评论

报告相同问题?

悬赏问题

  • ¥15 优质github账号直接兑换rmb,感兴趣伙伴可以私信
  • ¥15 错误(10048): “调用exui内部功能”库命令的参数“参数4”不能接受空数据。怎么解决啊
  • ¥15 安装svn网络有问题怎么办
  • ¥15 Python爬取指定微博话题下的内容,保存为txt
  • ¥15 vue2登录调用后端接口如何实现
  • ¥65 永磁型步进电机PID算法
  • ¥15 sqlite 附加(attach database)加密数据库时,返回26是什么原因呢?
  • ¥88 找成都本地经验丰富懂小程序开发的技术大咖
  • ¥15 如何处理复杂数据表格的除法运算
  • ¥15 如何用stc8h1k08的片子做485数据透传的功能?(关键词-串口)