You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@crunch.apache.org by "Josh Wills (JIRA)" <ji...@apache.org> on 2014/08/07 03:13:11 UTC

[jira] [Created] (CRUNCH-458) Eliminate potentially random MR split-point decisions

Josh Wills created CRUNCH-458:
---------------------------------

             Summary: Eliminate potentially random MR split-point decisions
                 Key: CRUNCH-458
                 URL: https://issues.apache.org/jira/browse/CRUNCH-458
             Project: Crunch
          Issue Type: Bug
            Reporter: Josh Wills


I'm running into a pipeline in which the decision of where to split two dependent jobs seems to be random from run-to-run (I only noticed it b/c one of the runs causes the pipeline to throw an NPE, and the other does not.) I'd like to investigate this and try to eliminate any potential sources of randomness in the way that two dependent GBK operations are split.



--
This message was sent by Atlassian JIRA
(v6.2#6252)