You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Ismael Juma (JIRA)" <ji...@apache.org> on 2016/11/30 15:41:58 UTC
[jira] [Updated] (KAFKA-4412) Replication fetch stuck in loop on
offset null
[ https://issues.apache.org/jira/browse/KAFKA-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ismael Juma updated KAFKA-4412:
-------------------------------
Labels: reliability (was: )
> Replication fetch stuck in loop on offset null
> ----------------------------------------------
>
> Key: KAFKA-4412
> URL: https://issues.apache.org/jira/browse/KAFKA-4412
> Project: Kafka
> Issue Type: Bug
> Components: replication
> Reporter: Xavier Lange
> Labels: reliability
>
> I kicked off a cluster rebalance and it never completed. I had to look at node eth0 traffic to see there was a constant 60MB/s (I'm usually at about 5MB/s ingest). The /kafka/logs/server.log was looping like this, then I deleted the topic in question to make it stop:
> {quote}
> [2016-11-15 18:21:27,745] ERROR Found invalid messages during fetch for partition [cisco-2016.11.13,19] offset 861323 error null (kafka.server.ReplicaFetcherThread)
> [2016-11-15 18:21:27,755] ERROR Found invalid messages during fetch for partition [cisco-2016.11.13,19] offset 861323 error null (kafka.server.ReplicaFetcherThread)
> [2016-11-15 18:21:27,773] ERROR Found invalid messages during fetch for partition [cisco-2016.11.13,19] offset 861323 error null (kafka.server.ReplicaFetcherThread)
> [2016-11-15 18:21:27,788] ERROR Found invalid messages during fetch for partition [cisco-2016.11.13,19] offset 861323 error null (kafka.server.ReplicaFetcherThread)
> [2016-11-15 18:21:27,847] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,19] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:27,852] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,11] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:27,853] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,9] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:27,855] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,3] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:27,856] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,16] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:27,857] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,2] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:27,858] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,19] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:28,012] INFO Deleting index /data/cisco-2016.11.13-19/00000000000000000000.index (kafka.log.OffsetIndex)
> [2016-11-15 18:21:28,016] INFO Deleted log for partition [cisco-2016.11.13,19] in /data/cisco-2016.11.13-19. (kafka.log.LogManager)
> [2016-11-15 18:21:28,024] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,11] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:28,165] INFO Deleting index /data/cisco-2016.11.13-11/00000000000000000000.index (kafka.log.OffsetIndex)
> [2016-11-15 18:21:28,165] INFO Deleted log for partition [cisco-2016.11.13,11] in /data/cisco-2016.11.13-11. (kafka.log.LogManager)
> [2016-11-15 18:21:28,167] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,9] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:28,232] INFO Deleting index /data/cisco-2016.11.13-9/00000000000000000000.index (kafka.log.OffsetIndex)
> [2016-11-15 18:21:28,232] INFO Deleted log for partition [cisco-2016.11.13,9] in /data/cisco-2016.11.13-9. (kafka.log.LogManager)
> [2016-11-15 18:21:28,242] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,3] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:28,341] INFO Deleting index /data/cisco-2016.11.13-3/00000000000000000000.index (kafka.log.OffsetIndex)
> [2016-11-15 18:21:28,342] INFO Deleted log for partition [cisco-2016.11.13,3] in /data/cisco-2016.11.13-3. (kafka.log.LogManager)
> [2016-11-15 18:21:28,375] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,16] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:28,465] INFO Deleting index /data/cisco-2016.11.13-16/00000000000000000000.index (kafka.log.OffsetIndex)
> [2016-11-15 18:21:28,466] INFO Deleted log for partition [cisco-2016.11.13,16] in /data/cisco-2016.11.13-16. (kafka.log.LogManager)
> [2016-11-15 18:21:28,469] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [cisco-2016.11.13,2] (kafka.server.ReplicaFetcherManager)
> [2016-11-15 18:21:28,486] INFO Deleting index /data/cisco-2016.11.13-2/00000000000000000000.index (kafka.log.OffsetIndex)
> [2016-11-15 18:21:28,486] INFO Deleted log for partition [cisco-2016.11.13,2] in /data/cisco-2016.11.13-2. (kafka.log.LogManager)
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)