You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@crunch.apache.org by "Joseph Adler (JIRA)" <ji...@apache.org> on 2013/06/10 17:57:20 UTC

[jira] [Created] (CRUNCH-217) Crunch PipelineResult objects do not capture failures

Joseph Adler created CRUNCH-217:
-----------------------------------

             Summary: Crunch PipelineResult objects do not capture failures
                 Key: CRUNCH-217
                 URL: https://issues.apache.org/jira/browse/CRUNCH-217
             Project: Crunch
          Issue Type: Bug
          Components: Core
    Affects Versions: 0.6.0
            Reporter: Joseph Adler
            Assignee: Josh Wills


We use Crunch within Azkaban (a scheduling a and workflow tool, similar to Oozie). We need to be able to run a crunch pipeline from within another Java program, then test for success using code like this:

{code}
    PipelineResult mainResult = mainPipeline.run();
    if (!mainResult.succeeded())
    {
        throw new Exception("Pipeline failed: " + mainPipeline.getName() + "\n");
    }
    return 0;
{code}

Currently, PipelineResult objects don't let you do this; the succeeded() method will always return true. 

I have enclosed a patch that addresses this issue for in-memory and map-reduce pipelines.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira