You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@crunch.apache.org by "Josh Wills (JIRA)" <ji...@apache.org> on 2013/09/29 03:56:23 UTC

[jira] [Created] (CRUNCH-271) Get the Counters for a job immediately upon Job completion

Josh Wills created CRUNCH-271:
---------------------------------

             Summary: Get the Counters for a job immediately upon Job completion
                 Key: CRUNCH-271
                 URL: https://issues.apache.org/jira/browse/CRUNCH-271
             Project: Crunch
          Issue Type: Bug
          Components: Core
    Affects Versions: 0.7.0
            Reporter: Josh Wills
            Assignee: Josh Wills
             Fix For: 0.8.0


It's possible for the Counters for a Job that runs in the early phase of a Crunch pipeline to no longer be available in the JobTracker at the end of the last pipeline run, when we go to ask the JT for the Counters for all of the jobs that were executed during the pipeline. Therefore, we should cache the Counters for each job in the CrunchControlledJob object at the time each Job completes, and then use the cached Counters in the pipeline stage reports.



--
This message was sent by Atlassian JIRA
(v6.1#6144)