本地kettle想要使用kafka consumer 组件，应该如何进行kerberos认证

Question

在spoon中执行kafka consumer组件报错：

2021/08/27 09:08:10 - consumertest1 - Dispatching started for transformation [consumertest1]
2021/08/27 09:08:10 - Kafka Consumer.0 - ERROR (version 8.0.0.0-28, build 8.0.0.0-28 from 2017-11-05 07.27.50 by buildguy) : Error initializing step [Kafka Consumer]
2021/08/27 09:08:10 - Kafka Consumer.0 - ERROR (version 8.0.0.0-28, build 8.0.0.0-28 from 2017-11-05 07.27.50 by buildguy) : org.apache.kafka.common.KafkaException: Failed to construct kafka consumer
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:811)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:624)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:605)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.pentaho.big.data.kettle.plugins.kafka.KafkaFactory.consumer(KafkaFactory.java:49)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.pentaho.big.data.kettle.plugins.kafka.KafkaConsumerInput.init(KafkaConsumerInput.java:117)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.pentaho.di.trans.step.StepInitThread.run(StepInitThread.java:69)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at java.lang.Thread.run(Thread.java:748)
2021/08/27 09:08:10 - Kafka Consumer.0 - Caused by: org.apache.kafka.common.KafkaException: javax.security.auth.login.LoginException: Client not found in Kerberos database (6) - CLIENT_NOT_FOUND
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:160)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:146)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:67)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:99)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:726)
2021/08/27 09:08:10 - Kafka Consumer.0 -     ... 6 more
2021/08/27 09:08:10 - Kafka Consumer.0 - Caused by: javax.security.auth.login.LoginException: Client not found in Kerberos database (6) - CLIENT_NOT_FOUND
2021/08/27 09:08:10 - Kafka Consumer.0 -     at com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:804)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at com.sun.security.auth.module.Krb5LoginModule.login(Krb5LoginModule.java:617)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at java.lang.reflect.Method.invoke(Method.java:498)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at javax.security.auth.login.LoginContext.invoke(LoginContext.java:755)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at javax.security.auth.login.LoginContext.access$000(LoginContext.java:195)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at javax.security.auth.login.LoginContext$4.run(LoginContext.java:682)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at javax.security.auth.login.LoginContext$4.run(LoginContext.java:680)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at java.security.AccessController.doPrivileged(Native Method)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:680)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at javax.security.auth.login.LoginContext.login(LoginContext.java:587)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.common.security.authenticator.AbstractLogin.login(AbstractLogin.java:60)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.common.security.kerberos.KerberosLogin.login(KerberosLogin.java:103)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.common.security.authenticator.LoginManager.<init>(LoginManager.java:61)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.common.security.authenticator.LoginManager.acquireLoginManager(LoginManager.java:104)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:149)
2021/08/27 09:08:10 - Kafka Consumer.0 -     ... 10 more
2021/08/27 09:08:10 - Kafka Consumer.0 - Caused by: KrbException: Client not found in Kerberos database (6) - CLIENT_NOT_FOUND
2021/08/27 09:08:10 - Kafka Consumer.0 -     at sun.security.krb5.KrbAsRep.<init>(KrbAsRep.java:82)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at sun.security.krb5.KrbAsReqBuilder.send(KrbAsReqBuilder.java:316)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at sun.security.krb5.KrbAsReqBuilder.action(KrbAsReqBuilder.java:361)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:776)
2021/08/27 09:08:10 - Kafka Consumer.0 -     ... 27 more
2021/08/27 09:08:10 - Kafka Consumer.0 - Caused by: KrbException: Identifier doesn't match expected value (906)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at sun.security.krb5.internal.KDCRep.init(KDCRep.java:140)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at sun.security.krb5.internal.ASRep.init(ASRep.java:64)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at sun.security.krb5.internal.ASRep.<init>(ASRep.java:59)
2021/08/27 09:08:10 - Kafka Consumer.0 -     at sun.security.krb5.KrbAsRep.<init>(KrbAsRep.java:60)
2021/08/27 09:08:10 - Kafka Consumer.0 -     ... 30 more
2021/08/27 09:08:10 - consumertest1 - ERROR (version 8.0.0.0-28, build 8.0.0.0-28 from 2017-11-05 07.27.50 by buildguy) : Step [Kafka Consumer.0] failed to initialize!

Answer 1

你好，我是有问必答小助手，非常抱歉，本次您提出的有问必答问题，技术专家团超时未为您做出解答


本次提问扣除的有问必答次数，将会以问答VIP体验卡（1次有问必答机会、商城购买实体图书享受95折优惠）的形式为您补发到账户。


因为有问必答VIP体验卡有效期仅有1天，您在需要使用的时候【私信】联系我，我会为您补发。