douzi9744
2018-03-26 11:53
浏览 578
已采纳

kafka服务器:偏移的主题尚未创建

I'm using Kafka server 0.9 + zookeper. I'm new with Kafka. It's running in virtualbox , I can connect to it using public IP so it's working ... more or less: can get topics and messages. So for now I have 2 issues:

  1. I can't find anything at __consumer_offsets (empty) and that's why I've got issue with the go simple consumer script throwing error: kafka server: Offset's topic has not yet been created; when i check at zookeeper-shell.sh console by command ls /brokers/topics/__consumer_offsets it errors me : Node does not exist: /brokers/topics/__consumer_offsets

  2. (maybe they are connected) I've got minor warning when autocreating topic: WARN NetworkClient - Error while fetching metadata with correlation id 4157 : {topicName=LEADER_NOT_AVAILABLE}

Any help it highly appreciated. Thanks!

图片转代码服务由CSDN问答提供 功能建议

我正在使用Kafka服务器0.9 + zookeper。 我是Kafka的新手。 它在virtualbox中运行,我可以使用公共IP连接到它,因此它可以工作……或多或少:可以获取主题和消息。 所以现在我有2个问题:

    \ n
  1. 我在__consumer_offsets(空)上找不到任何东西,这就是为什么我遇到了转到简单的消费者脚本抛出错误的问题: kafka服务器:偏移的主题尚未创建; 当我通过命令 ls / brokers / topics / __ consumer_offsets 在zookeeper-shell.sh控制台上检查时,它使我出错:节点不存在:/ brokers / topics / __ consumer_offsets

  2. (也许它们已连接)(在自动创建主题时),我得到了次要警告: WARN NetworkClient-提取关联ID为4157的元数据时出错:{topicName = LEADER_NOT_AVAILABLE}

    任何对它的帮助都值得赞赏。 谢谢!

  • 点赞
  • 写回答
  • 关注问题
  • 收藏
  • 邀请回答

2条回答 默认 最新

  • douduan5073 2018-03-26 13:50
    已采纳

    The reason was successfully found in logs : Number of alive brokers '1' does not meet the required replication factor '3' for the offsets topic you need to post into your server.properties file following option : offsets.topic.replication.factor=1. This option will not let you do anything till the count reaches 3 but since you have it set as a playbox - you usually have 1 only.

    点赞 打赏 评论
  • douque8861 2018-03-26 13:37

    The __consumer_offsets topic is created automatically when a consumer using a group connects to the cluster.

    By default, Sarama does not support groups (https://github.com/Shopify/sarama/wiki/Frequently-Asked-Questions#how-can-i-use-sarama-to-monitor-or-join-a-consumer-group), so unless you are using the cluster extension (https://github.com/bsm/sarama-cluster) this is expected.

    You can use the kafka-console-consumer.sh tool that comes with Kafka to create it if you want.

    点赞 打赏 评论

相关推荐 更多相似问题