kafka集群报错： Invalid receive (size = 1212501072 larger than 419430400)

Question

问题遇到的现象和发生背景

kafka集群频繁报错

[2022-08-10 17:06:21,806] WARN [SocketServer brokerId=3] Unexpected error from /39.103.165.234; closing connection (org.apache.kafka.common.network.Selector)
org.apache.kafka.common.network.InvalidReceiveException: Invalid receive (size = 1212501072 larger than 419430400)
at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:104)
at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:424)
at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:385)
at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:651)
at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:572)
at org.apache.kafka.common.network.Selector.poll(Selector.java:483)
at kafka.network.Processor.poll(SocketServer.scala:890)
at kafka.network.Processor.run(SocketServer.scala:789)

官网说是异常访问http 导致报文过大 有个解决方案是重写kafka原生方法

重新方法操作性不太高 有没有操作性强的解决方案 （除了调大内存 [doge]）

Answer 1

你把报错的代码发给我看一下 我