You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Hai Lin (Jira)" <ji...@apache.org> on 2020/04/30 17:29:00 UTC

[jira] [Commented] (KAFKA-9181) Flaky test kafka.api.SaslGssapiSslEndToEndAuthorizationTest.testNoConsumeWithoutDescribeAclViaSubscribe

    [ https://issues.apache.org/jira/browse/KAFKA-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096800#comment-17096800 ] 

Hai Lin commented on KAFKA-9181:
--------------------------------

I did notice some issue after this patch, here is what I observe.

Consumer metadata might skip first metadata update, cause grouopSubscription is not reset. In my case, the consumer coordinator thread hijack the update by calling newMetadataRequestAndVersion with outdated groupSubscription before joinPrepare() happen. The groupSubscription will get reset later and it will eventually get update later, and this won't be an issue for initial consumer subscribe(since the groupSubscription is empty anyway), but it might happen the following subscribe when groupSubscription is not empty. This will create a discrepancy between subscription and groupSubscription, if any new metadata request happened in between, metadataTopics will return outdated group information. 

 
h4. The happy path
 * Consumer call subscribe -> Update {{needUpdated}}, bump up {{requestVersion}} and update {{subscription}} in {{SubscriptionState}} -> {{prepareJoin()}} was call in first {{poll()}} to reset {{groupSubscription}} -> next time when metadata update was call and {{metadataTopics()}} returns {{subscription}} since {{groupSubscription}} is empty -> update call issue to broker to fetch partition information for new topic

h4. In our case
 * Consumer call subscribe -> Update {{needUpdated}}, bump up {{requestVersion}} and update {{subscription}}(not {{groupSubscription}}) in {{SubscriptionState}} -> Consumer Coordinator heartbeat thread call metadata request and {{SubscriptionState}} gave away the current requestVersion and outdated {{groupSubscription}} -> making request for metadata update with outdated subscription -> request comes back to client and since {{requestVersion}} is up to latest, it reset {{needUpdated}} flag -> {{joinPrepare()}} called and reset {{groupSubscription}} -> no new metadata update request follow cause {{needUpdated}} was reset -> metadata request will happen when {{metadata.max.age}} reaches.

 

I saw some discussion in the pull request, don't know if I miss anything here.

> Flaky test kafka.api.SaslGssapiSslEndToEndAuthorizationTest.testNoConsumeWithoutDescribeAclViaSubscribe
> -------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-9181
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9181
>             Project: Kafka
>          Issue Type: Test
>          Components: core
>            Reporter: Bill Bejeck
>            Assignee: Rajini Sivaram
>            Priority: Major
>              Labels: flaky-test, tests
>             Fix For: 2.5.0
>
>
> Failed in [https://builds.apache.org/job/kafka-pr-jdk8-scala2.11/26571/testReport/junit/kafka.api/SaslGssapiSslEndToEndAuthorizationTest/testNoConsumeWithoutDescribeAclViaSubscribe/]
>  
> {noformat}
> Error Messageorg.apache.kafka.common.errors.TopicAuthorizationException: Not authorized to access topics: [topic2]Stacktraceorg.apache.kafka.common.errors.TopicAuthorizationException: Not authorized to access topics: [topic2]
> Standard OutputAdding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka6494439724844851846.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:43:16,187] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:43:16,191] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:43:16,384] ERROR [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:43:16,384] ERROR [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW) 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Read from hosts: *
> 	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka3083328529571706878.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka3083328529571706878.tmp refreshKrb5Config is false principal is client2@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client2@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:43:17,549] ERROR [Consumer clientId=consumer-group-255, groupId=group] Topic authorization failed for topics [e2etopic] (org.apache.kafka.clients.Metadata:283)
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka2790389872392408045.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:43:43,513] ERROR [ReplicaFetcher replicaId=2, leaderId=1, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:43:43,513] ERROR [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:43:43,682] ERROR [ReplicaFetcher replicaId=2, leaderId=1, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:43:43,683] ERROR [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka3639280670011131711.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Create from hosts: * 
> [2019-11-13 04:43:45,193] ERROR [Consumer clientId=consumer-group-256, groupId=group] Topic authorization failed for topics [e2etopic] (org.apache.kafka.clients.Metadata:283)
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW) 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Read from hosts: *
> 	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: * 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> [2019-11-13 04:43:45,698] ERROR [Consumer clientId=consumer-group-256, groupId=group] Topic authorization failed for topics [topic2] (org.apache.kafka.clients.Metadata:283)
> [2019-11-13 04:43:45,700] ERROR [Consumer clientId=consumer-group-256, groupId=group] Topic authorization failed for topics [topic2] (org.apache.kafka.clients.Metadata:283)
> [2019-11-13 04:43:47,205] ERROR [Consumer clientId=consumer-group-256, groupId=group] Topic authorization failed for topics [topic2] (org.apache.kafka.clients.Metadata:283)
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka2853735962705514989.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:44:10,330] ERROR [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:44:10,331] ERROR [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:44:10,531] ERROR [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:44:10,531] ERROR [ReplicaFetcher replicaId=2, leaderId=1, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2e, patternType=PREFIXED)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=gr, patternType=PREFIXED)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:PREFIXED:e2e`: 
>  	User:client has Allow permission for operations: Read from hosts: *
> 	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Current ACLs for resource `Group:PREFIXED:gr`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka3614118284002283090.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka3343806238750489399.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:44:42,245] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:44:42,262] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:44:42,453] ERROR [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:44:42,461] ERROR [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW) 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Read from hosts: *
> 	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka2293718255849931457.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka8247896269514574204.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:45:09,679] ERROR [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:45:09,687] ERROR [ReplicaFetcher replicaId=2, leaderId=1, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:45:09,901] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:45:09,902] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka6165264118808778893.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka5588216719148826164.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:45:44,360] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:45:44,366] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:45:44,553] ERROR [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:45:44,553] ERROR [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=topic2, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:topic2`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=topic2, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW) 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:topic2`: 
>  	User:client has Allow permission for operations: Read from hosts: *
> 	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka8937168000923149954.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:45:45,239] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition topic2-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:45:45,239] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition topic2-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka1753713975062534365.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:46:13,255] ERROR [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:46:13,261] ERROR [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:46:13,522] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:46:13,527] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=*, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Read from hosts: *
> 	User:kafka has Allow permission for operations: Read from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Current ACLs for resource `Group:LITERAL:*`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka4579277064687399324.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka1211513173897695002.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:46:38,320] ERROR [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:46:38,323] ERROR [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:46:38,521] ERROR [ReplicaFetcher replicaId=2, leaderId=1, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:46:38,526] ERROR [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka4859545116775501587.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka5936495479832727441.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:47:13,934] ERROR [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:47:13,939] ERROR [ReplicaFetcher replicaId=2, leaderId=1, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:47:14,142] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:47:14,143] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka5030780877268645002.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Create from hosts: * 
> [2019-11-13 04:47:15,675] ERROR [Consumer clientId=consumer-group-263, groupId=group] Topic authorization failed for topics [e2etopic] (org.apache.kafka.clients.Metadata:283)
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka2819838905642285118.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:47:43,623] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:47:43,635] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:47:43,831] ERROR [ReplicaFetcher replicaId=2, leaderId=1, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:47:43,831] ERROR [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka7821381619195888442.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka7294747755465828555.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:48:13,692] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:48:13,705] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:48:13,880] ERROR [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:48:13,884] ERROR [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Describe from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka2522835534939702730.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka8641154754165823659.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:48:39,064] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:48:39,074] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:48:39,267] ERROR [ReplicaFetcher replicaId=2, leaderId=1, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:48:39,268] ERROR [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka4420357362687484380.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:48:39,713] ERROR [Producer clientId=producer-422] Topic authorization failed for topics [e2etopic] (org.apache.kafka.clients.Metadata:283)
> [2019-11-13 04:48:39,740] ERROR [Consumer clientId=consumer-group-265, groupId=group] Topic authorization failed for topics [e2etopic] (org.apache.kafka.clients.Metadata:283)
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=topic2, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:topic2`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=topic2, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW) 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:topic2`: 
>  	User:client has Allow permission for operations: Read from hosts: *
> 	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> [2019-11-13 04:48:40,327] ERROR [Producer clientId=producer-422] Topic authorization failed for topics [e2etopic] (org.apache.kafka.clients.Metadata:283)
> [2019-11-13 04:48:40,429] ERROR [Producer clientId=producer-422] Topic authorization failed for topics [e2etopic] (org.apache.kafka.clients.Metadata:283)
> [2019-11-13 04:48:41,185] ERROR [Consumer clientId=consumer-group-265, groupId=group] Topic authorization failed for topics [e2etopic] (org.apache.kafka.clients.Metadata:283)
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW) 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Read from hosts: *
> 	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=CLUSTER, name=kafka-cluster, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=CLUSTER_ACTION, permissionType=ALLOW) 
> Current ACLs for resource `Cluster:LITERAL:kafka-cluster`: 
>  	User:kafka has Allow permission for operations: ClusterAction from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=*, patternType=LITERAL)`: 
>  	(principal=User:kafka, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:*`: 
>  	User:kafka has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka8725022246516193653.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is kafka/localhost@EXAMPLE.COM
> Will use keytab
> Commit Succeeded 
> [2019-11-13 04:49:10,578] ERROR [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:49:10,578] ERROR [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error for partition __consumer_offsets-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:49:10,775] ERROR [ReplicaFetcher replicaId=1, leaderId=0, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> [2019-11-13 04:49:10,780] ERROR [ReplicaFetcher replicaId=2, leaderId=0, fetcherId=0] Error for partition e2etopic-0 at offset 0 (kafka.server.ReplicaFetcherThread:76)
> org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=WRITE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=CREATE, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Adding ACLs for resource `ResourcePattern(resourceType=TOPIC, name=e2etopic, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW)
> 	(principal=User:client, host=*, operation=DESCRIBE, permissionType=ALLOW) 
> Adding ACLs for resource `ResourcePattern(resourceType=GROUP, name=group, patternType=LITERAL)`: 
>  	(principal=User:client, host=*, operation=READ, permissionType=ALLOW) 
> Current ACLs for resource `Topic:LITERAL:e2etopic`: 
>  	User:client has Allow permission for operations: Read from hosts: *
> 	User:client has Allow permission for operations: Describe from hosts: *
> 	User:client has Allow permission for operations: Write from hosts: *
> 	User:client has Allow permission for operations: Create from hosts: * 
> Current ACLs for resource `Group:LITERAL:group`: 
>  	User:client has Allow permission for operations: Read from hosts: * 
> Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka6140470407592077851.tmp refreshKrb5Config is false principal is client@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
> principal is client@EXAMPLE.COM
> Will use keytab
> Commit Succeeded {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)