You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jay Kreps (Created) (JIRA)" <ji...@apache.org> on 2011/11/29 19:43:39 UTC
[jira] [Created] (KAFKA-217) Client test suite
Client test suite
-----------------
Key: KAFKA-217
URL: https://issues.apache.org/jira/browse/KAFKA-217
Project: Kafka
Issue Type: Improvement
Reporter: Jay Kreps
It would be great to get a comprehensive test suite that we could run against clients to certify them.
The first step here would be work out a design approach that makes it easy to certify the correctness of a client.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (KAFKA-217) Client test suite
Posted by "David Ormsbee (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/KAFKA-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161286#comment-13161286 ]
David Ormsbee commented on KAFKA-217:
-------------------------------------
I like the packet dumps idea from a simplicity point of view. We could have a set of YAML files that represent types of compliance (e.g. simpleconsumer_0.7.yaml), maybe even put the message data in fields as base64 encoded strings. We don't have to worry about invoking clients on the command line -- each client would just know to read the file and the file would specify what the raw data is and the intended results. It also saves us from having to bring up older versions of Kafka to live test against.
That being said, is there any simple way to test a ZooKeeper Consumer/Producer? The only thing I can think of is to specify a standard command-line interface that clients need to implement, and then have a test script that spins up ZooKeeper and a few Kafka brokers, calls these client commands, and then inspects the output and the ZK state.
> Client test suite
> -----------------
>
> Key: KAFKA-217
> URL: https://issues.apache.org/jira/browse/KAFKA-217
> Project: Kafka
> Issue Type: Improvement
> Reporter: Jay Kreps
>
> It would be great to get a comprehensive test suite that we could run against clients to certify them.
> The first step here would be work out a design approach that makes it easy to certify the correctness of a client.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (KAFKA-217) Client test suite
Posted by "Jeffrey Damick (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/KAFKA-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159529#comment-13159529 ]
Jeffrey Damick commented on KAFKA-217:
--------------------------------------
I'd like to see packet dumps of all the message types (from all versions) so that they can be used int unit tests of the clients and with the packet dumps that definition should include information about what to expect inside the data once it has been parsed, for example the CRC value, the value of a message that is compressed. Then the implementation can assert that it is in fact parsing and generating the packets correctly. These could be encapsulated into a test harness or test mode of the broker that the client could run a full integration test against as well.
> Client test suite
> -----------------
>
> Key: KAFKA-217
> URL: https://issues.apache.org/jira/browse/KAFKA-217
> Project: Kafka
> Issue Type: Improvement
> Reporter: Jay Kreps
>
> It would be great to get a comprehensive test suite that we could run against clients to certify them.
> The first step here would be work out a design approach that makes it easy to certify the correctness of a client.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (KAFKA-217) Client test suite
Posted by "Jay Kreps (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/KAFKA-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159444#comment-13159444 ]
Jay Kreps commented on KAFKA-217:
---------------------------------
Thread is here: http://mail-archives.apache.org/mod_mbox/incubator-kafka-dev/201111.mbox/%3CCAOeJiJjRHB2c1T-OCre-ZwpDhg+HkVBo2TMyVaYKXsTvEL9PnQ@mail.gmail.com%3E
Some thoughts:
- It would be good to break out specific features to get a level of compliance: producer, compression types, consumer, etc
- It would be good to test clients against various protocol versions to test forwards and backwards compatibility
> Client test suite
> -----------------
>
> Key: KAFKA-217
> URL: https://issues.apache.org/jira/browse/KAFKA-217
> Project: Kafka
> Issue Type: Improvement
> Reporter: Jay Kreps
>
> It would be great to get a comprehensive test suite that we could run against clients to certify them.
> The first step here would be work out a design approach that makes it easy to certify the correctness of a client.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira