You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@bigtop.apache.org by "jay vyas (JIRA)" <ji...@apache.org> on 2013/09/08 19:23:51 UTC

[jira] [Created] (BIGTOP-1065) Stress Tests

jay vyas created BIGTOP-1065:
--------------------------------

             Summary: Stress Tests 
                 Key: BIGTOP-1065
                 URL: https://issues.apache.org/jira/browse/BIGTOP-1065
             Project: Bigtop
          Issue Type: Test
            Reporter: jay vyas
            Priority: Minor


There are issues in the past where the JobTracker has failures because of so called "memory-leaks" , or infinitely growing objects, unclean tmp/ folders from jobs, etc.  

Thus, the proposal here is a lighteweight job which can be run rapidly, several 1000 times, which confirms that jobtracker state does not grow out of bounds or infinitely with respect to number of tasks/jobs run/submitted. 

IMPLEMENTATION PROPOSAL: 

Some simple starts would be to : 

- run word count, or a the sleep job 100 or 1000 times or 10,000 times.  

- create and delete the same file over and over again several thousand times to see if filesystem consistency is maintained 

To start, I'd like to add all these tests in a single module , under test-executions/stress/.  Then later we could shard it out in another way.



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira