You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jun Rao (JIRA)" <ji...@apache.org> on 2016/07/08 21:28:11 UTC
[jira] [Updated] (KAFKA-3163) KIP-33 - Add a time based log index
to Kafka
[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jun Rao updated KAFKA-3163:
---------------------------
Attachment: 00000000000000113931.timeindex
00000000000000113931.log
Also, I ran the following tool in the patch on the attached timeindex file and got a bunch of errors.
kafka-run-class.sh kafka.tools.DumpLogSegments --files /tmp/kafka-logs/test-0/00000000000000113931.timeindex
timestamp: 1468010788307(log timestamp: 1468010788303) offset: 113946(log offset: 113931)
timestamp: 1468010788308(log timestamp: 1468010788303) offset: 113976(log offset: 113931)
timestamp: 1468010788309(log timestamp: 1468010788303) offset: 114006(log offset: 113931)
timestamp: 1468010788310(log timestamp: 1468010788303) offset: 114036(log offset: 113931)
timestamp: 1468010788311(log timestamp: 1468010788303) offset: 114081(log offset: 113931)
timestamp: 1468010788312(log timestamp: 1468010788303) offset: 114111(log offset: 113931)
timestamp: 1468010788313(log timestamp: 1468010788303) offset: 114156(log offset: 113931)
timestamp: 1468010788314(log timestamp: 1468010788303) offset: 114201(log offset: 113931)
Found timestamp mismatch in :/tmp/kafka-logs/test-0/00000000000000113931.timeindex
Index timestamp: 1468010788314, log timestamp: 1468010788303
Index timestamp: 1468010788313, log timestamp: 1468010788303
Index timestamp: 1468010788312, log timestamp: 1468010788303
Index timestamp: 1468010788311, log timestamp: 1468010788303
Index timestamp: 1468010788310, log timestamp: 1468010788303
Index timestamp: 1468010788309, log timestamp: 1468010788303
Index timestamp: 1468010788308, log timestamp: 1468010788303
Index timestamp: 1468010788307, log timestamp: 1468010788303
A few things: (1) The data is populated with the producer performance tool. So, the time index shouldn't be corrupted. (2) It's a bit hard to understand the output. It's not clear what's in the bracket really means and it's not clear that indicates an error. It's also a bit weird that the same error is print again later and in reverse timestamp order.
> KIP-33 - Add a time based log index to Kafka
> --------------------------------------------
>
> Key: KAFKA-3163
> URL: https://issues.apache.org/jira/browse/KAFKA-3163
> Project: Kafka
> Issue Type: Task
> Components: core
> Reporter: Jiangjie Qin
> Assignee: Jiangjie Qin
> Fix For: 0.10.1.0
>
> Attachments: 00000000000000113931.log, 00000000000000113931.timeindex
>
>
> This ticket is associated with KIP-33.
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)