You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@crunch.apache.org by "Matthias Friedrich (JIRA)" <ji...@apache.org> on 2012/08/13 08:10:38 UTC

[jira] [Commented] (CRUNCH-42) Improve speed of running integration tests

    [ https://issues.apache.org/jira/browse/CRUNCH-42?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13432942#comment-13432942 ] 

Matthias Friedrich commented on CRUNCH-42:
------------------------------------------

Patch applies nicely and looks good. Can't see why it wouldn't work. Oh, and it's brilliant idea :)
                
> Improve speed of running integration tests
> ------------------------------------------
>
>                 Key: CRUNCH-42
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-42
>             Project: Crunch
>          Issue Type: Improvement
>    Affects Versions: 0.3.0
>            Reporter: Gabriel Reid
>            Assignee: Gabriel Reid
>            Priority: Minor
>         Attachments: 0001-Use-short-job-poll-interval-when-in-local-mode.patch
>
>
> The CrunchJobControl currently uses a hard-coded poll interval of 5 seconds to check on running jobs. This is valid when running jobs on large datasets on a cluster, but results in unnecessary waiting when running in local mode. By using a smaller poll interval when running in local mode, the performance of the integration tests can be greatly improved.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira