You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Evan Chan (JIRA)" <ji...@apache.org> on 2012/06/19 06:29:42 UTC
[jira] [Commented] (KAFKA-266) Kafka web console design
[ https://issues.apache.org/jira/browse/KAFKA-266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396503#comment-13396503 ]
Evan Chan commented on KAFKA-266:
---------------------------------
BTW, just some thoughts. I'm thinking of not so much a web console for individual Kafka brokers, but a web console for an entire Kafka cluster, targetting mostly smaller clusters. This would grab information from ZK and from JMX (or JMX-over-HTTP) for individual brokers to put together reports like:
- Status of different Kafka brokers in the cluster, including overall read and write rates, etc.
- Information on consumers (at least the high level consumers registered in ZK), outstanding messages or how far behind they are, etc.
> Kafka web console design
> ------------------------
>
> Key: KAFKA-266
> URL: https://issues.apache.org/jira/browse/KAFKA-266
> Project: Kafka
> Issue Type: New Feature
> Components: contrib
> Reporter: Evan Chan
> Original Estimate: 672h
> Remaining Estimate: 672h
>
> This issue is created to track a community-contributed Kafka Web UI.
> Here is an initial list of goals:
> - Be able to easily see which brokers are up
> - Be able to see lists of topics, connected producers, consumer groups, connected consumers
> - Be able to see, for each consumer/partition, its offset, and more importantly, # of bytes unconsumed (== largest offset for partition - current offset)
> - (Wish list) have a graphical view of the offsets
> - (Wish list) be able to clean up consumer state, such as stale claimed partitions
> List of challenges/questions:
> - Which framework? Play! for Scala?
> - Is all the data available from JMX and ZK? Hopefully, watching the files on the filesystem can be avoided....
> - How to handle large numbers of topics, partitions, consumers, etc. efficiently
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira