You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org> on 2011/05/02 22:43:03 UTC
[jira] [Commented] (PIG-1883) Pig's progress estimation should
account for parallel job executions
[ https://issues.apache.org/jira/browse/PIG-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13027830#comment-13027830 ]
jiraposter@reviews.apache.org commented on PIG-1883:
----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/683/
-----------------------------------------------------------
Review request for pig.
Summary
-------
This is Laukik's patch for PIG-1883
This addresses bug PIG-1883.
https://issues.apache.org/jira/browse/PIG-1883
Diffs
-----
trunk/src/org/apache/pig/Main.java 1097661
trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/Launcher.java 1097661
trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceLauncher.java 1097661
trunk/src/org/apache/pig/impl/plan/OperatorPlan.java 1097661
trunk/src/org/apache/pig/scripting/SyncProgressNotificationAdaptor.java 1097661
trunk/src/org/apache/pig/tools/pigstats/PigProgressNotificationListener.java 1097661
trunk/src/org/apache/pig/tools/pigstats/ScriptState.java 1097661
trunk/test/org/apache/pig/test/TestOperatorPlan.java 1097661
Diff: https://reviews.apache.org/r/683/diff
Testing
-------
Thanks,
Alan
> Pig's progress estimation should account for parallel job executions
> --------------------------------------------------------------------
>
> Key: PIG-1883
> URL: https://issues.apache.org/jira/browse/PIG-1883
> Project: Pig
> Issue Type: Improvement
> Reporter: Laukik Chitnis
> Assignee: Laukik Chitnis
> Attachments: PIG-1883-2.patch
>
>
> Currently, Pig's progress estimation is based on the percentage of jobs completed out of the total number of MR jobs. However, since the MR operators are arranged in a DAG (and hence more than 1 job might be submitted for execution in parallel), the progress estimation can be improved by considering the number of jobs in the critical path, instead of just the total number of jobs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira