[jira] [Updated] (PIG-1883) Pig's progress estimation should account for parallel job executions

["Laukik Chitnis (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PIG-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Laukik Chitnis updated PIG-1883:
--------------------------------

    Attachment: PIG-1883-2.patch

This patch adds methods to compute the critical path in an operator plan based on the number of nodes. It also uses the minimum progress along these many number of jobs to calculate the total progress. A new cmd line option is also added to enable this for progress reporting instead of the old estimation technique based purely on the total number of jobs.

> Pig's progress estimation should account for parallel job executions
> --------------------------------------------------------------------
>
>                 Key: PIG-1883
>                 URL: https://issues.apache.org/jira/browse/PIG-1883
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Laukik Chitnis
>            Assignee: Laukik Chitnis
>         Attachments: PIG-1883-2.patch
>
>
> Currently, Pig's progress estimation is based on the percentage of jobs completed out of the total number of MR jobs. However, since the MR operators are arranged in a DAG (and hence more than 1 job might be submitted for execution in parallel), the progress estimation can be improved by considering the number of jobs in the critical path, instead of just the total number of jobs.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira