[jira] Commented: (CHUKWA-368) proposed stress test

["Ari Rabkin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CHUKWA-368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12739091#action_12739091 ] 

Ari Rabkin commented on CHUKWA-368:
-----------------------------------

My proposal is as follows: modify ConstRateSender to emit, instead of random bytes, a byte pattern that depends on the sequence number of the Chunk being produced.  (This is a small and painless change).

Second, a MapReduce job that looks for that pattern and verifies that each chunk shows up at least once, that counts the number of duplicates, and that verifies that Chunks aren't corrupted.

Really, I'm worried about lost or duplicate chunks; the data pattern thing is just easy to do at the same time.

> proposed stress test
> --------------------
>
>                 Key: CHUKWA-368
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-368
>             Project: Hadoop Chukwa
>          Issue Type: New Feature
>          Components: build and test code
>            Reporter: Ari Rabkin
>
> I'd like to build a stress-test for Chukwa, to verify that collectors don't lose or corrupt data under high load.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.