You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Dave DeMaagd (Created) (JIRA)" <ji...@apache.org> on 2012/03/23 01:24:22 UTC

[jira] [Created] (KAFKA-313) Add JSON output and looping options to ConsumerOffsetChecker

Add JSON output and looping options to ConsumerOffsetChecker
------------------------------------------------------------

                 Key: KAFKA-313
                 URL: https://issues.apache.org/jira/browse/KAFKA-313
             Project: Kafka
          Issue Type: Improvement
            Reporter: Dave DeMaagd
            Priority: Minor


Adds:
* '--loop N' - causes the program to loop forever, sleeping for up to N seconds between loops (loop time minus collection time, unless that's less than 0, at which point it will just run again immediately)
* '--asjson' - display as a JSON string instead of the more human readable output format.

Neither of the above  depend on each other (you can loop in the human readable output, or do a single shot execution with JSON output).  Existing behavior/output maintained if neither of the above are used.  Diff Attached.

Impacted files:

core/src/main/scala/kafka/tools/ConsumerOffsetChecker.scala

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (KAFKA-313) Add JSON output and looping options to ConsumerOffsetChecker

Posted by "Dave DeMaagd (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/KAFKA-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dave DeMaagd updated KAFKA-313:
-------------------------------

    Attachment: KAFKA-313-2012032200.diff
    
> Add JSON output and looping options to ConsumerOffsetChecker
> ------------------------------------------------------------
>
>                 Key: KAFKA-313
>                 URL: https://issues.apache.org/jira/browse/KAFKA-313
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Dave DeMaagd
>            Priority: Minor
>              Labels: patch
>         Attachments: KAFKA-313-2012032200.diff
>
>
> Adds:
> * '--loop N' - causes the program to loop forever, sleeping for up to N seconds between loops (loop time minus collection time, unless that's less than 0, at which point it will just run again immediately)
> * '--asjson' - display as a JSON string instead of the more human readable output format.
> Neither of the above  depend on each other (you can loop in the human readable output, or do a single shot execution with JSON output).  Existing behavior/output maintained if neither of the above are used.  Diff Attached.
> Impacted files:
> core/src/main/scala/kafka/tools/ConsumerOffsetChecker.scala

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (KAFKA-313) Add JSON output and looping options to ConsumerOffsetChecker

Posted by "Joel Koshy (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/KAFKA-313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434531#comment-13434531 ] 

Joel Koshy commented on KAFKA-313:
----------------------------------

I worked with Dave on another version of this patch but will need to revisit. We can add CSV as well.
                
> Add JSON output and looping options to ConsumerOffsetChecker
> ------------------------------------------------------------
>
>                 Key: KAFKA-313
>                 URL: https://issues.apache.org/jira/browse/KAFKA-313
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Dave DeMaagd
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.8
>
>         Attachments: KAFKA-313-2012032200.diff
>
>
> Adds:
> * '--loop N' - causes the program to loop forever, sleeping for up to N seconds between loops (loop time minus collection time, unless that's less than 0, at which point it will just run again immediately)
> * '--asjson' - display as a JSON string instead of the more human readable output format.
> Neither of the above  depend on each other (you can loop in the human readable output, or do a single shot execution with JSON output).  Existing behavior/output maintained if neither of the above are used.  Diff Attached.
> Impacted files:
> core/src/main/scala/kafka/tools/ConsumerOffsetChecker.scala

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (KAFKA-313) Add JSON output and looping options to ConsumerOffsetChecker

Posted by "Jay Kreps (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/KAFKA-313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434484#comment-13434484 ] 

Jay Kreps commented on KAFKA-313:
---------------------------------

Is JSON better than CSV for this kind of thing? CSV is sometimes more shell friendly and that is what we are using for the perf tests...

If we like JSON then I am +1
                
> Add JSON output and looping options to ConsumerOffsetChecker
> ------------------------------------------------------------
>
>                 Key: KAFKA-313
>                 URL: https://issues.apache.org/jira/browse/KAFKA-313
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Dave DeMaagd
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.8
>
>         Attachments: KAFKA-313-2012032200.diff
>
>
> Adds:
> * '--loop N' - causes the program to loop forever, sleeping for up to N seconds between loops (loop time minus collection time, unless that's less than 0, at which point it will just run again immediately)
> * '--asjson' - display as a JSON string instead of the more human readable output format.
> Neither of the above  depend on each other (you can loop in the human readable output, or do a single shot execution with JSON output).  Existing behavior/output maintained if neither of the above are used.  Diff Attached.
> Impacted files:
> core/src/main/scala/kafka/tools/ConsumerOffsetChecker.scala

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (KAFKA-313) Add JSON output and looping options to ConsumerOffsetChecker

Posted by "Joel Koshy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/KAFKA-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joel Koshy updated KAFKA-313:
-----------------------------

    Fix Version/s: 0.8

This tool also needs to be updated for 0.8 for the broker failure and other system tests.
                
> Add JSON output and looping options to ConsumerOffsetChecker
> ------------------------------------------------------------
>
>                 Key: KAFKA-313
>                 URL: https://issues.apache.org/jira/browse/KAFKA-313
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Dave DeMaagd
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.8
>
>         Attachments: KAFKA-313-2012032200.diff
>
>
> Adds:
> * '--loop N' - causes the program to loop forever, sleeping for up to N seconds between loops (loop time minus collection time, unless that's less than 0, at which point it will just run again immediately)
> * '--asjson' - display as a JSON string instead of the more human readable output format.
> Neither of the above  depend on each other (you can loop in the human readable output, or do a single shot execution with JSON output).  Existing behavior/output maintained if neither of the above are used.  Diff Attached.
> Impacted files:
> core/src/main/scala/kafka/tools/ConsumerOffsetChecker.scala

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira