You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2011/09/22 02:45:27 UTC
[jira] [Commented] (PIG-1883) Pig's progress estimation should
account for parallel job executions
[ https://issues.apache.org/jira/browse/PIG-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13112265#comment-13112265 ]
Daniel Dai commented on PIG-1883:
---------------------------------
+1 for Thejas's additional change in MapReduceLauncher.java
> Pig's progress estimation should account for parallel job executions
> --------------------------------------------------------------------
>
> Key: PIG-1883
> URL: https://issues.apache.org/jira/browse/PIG-1883
> Project: Pig
> Issue Type: Improvement
> Reporter: Laukik Chitnis
> Assignee: Laukik Chitnis
> Attachments: PIG-1883-2.patch, PIG-1883-3.patch, PIG-1883.4.patch
>
>
> Currently, Pig's progress estimation is based on the percentage of jobs completed out of the total number of MR jobs. However, since the MR operators are arranged in a DAG (and hence more than 1 job might be submitted for execution in parallel), the progress estimation can be improved by considering the number of jobs in the critical path, instead of just the total number of jobs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira