You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Olga Natkovich (JIRA)" <ji...@apache.org> on 2009/01/29 03:18:59 UTC
[jira] Created: (PIG-647) memory sized passed on pig command line
does not get propagated to JobConf
memory sized passed on pig command line does not get propagated to JobConf
--------------------------------------------------------------------------
Key: PIG-647
URL: https://issues.apache.org/jira/browse/PIG-647
Project: Pig
Issue Type: Bug
Reporter: Olga Natkovich
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-647) memory sized passed on pig command line
does not get propagated to JobConf
Posted by "Alan Gates (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668743#action_12668743 ]
Alan Gates commented on PIG-647:
--------------------------------
+1
> memory sized passed on pig command line does not get propagated to JobConf
> --------------------------------------------------------------------------
>
> Key: PIG-647
> URL: https://issues.apache.org/jira/browse/PIG-647
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Santhosh Srinivasan
> Attachments: PIG-647.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-647) memory sized passed on pig command line
does not get propagated to JobConf
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668291#action_12668291 ]
Olga Natkovich commented on PIG-647:
------------------------------------
if we pass this on command line, we still see -Dmapred.child.java.opts="-Xmx1024m"' , we don't see this reflected in JobConf passed to hadoop.
> memory sized passed on pig command line does not get propagated to JobConf
> --------------------------------------------------------------------------
>
> Key: PIG-647
> URL: https://issues.apache.org/jira/browse/PIG-647
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (PIG-647) memory sized passed on pig command line
does not get propagated to JobConf
Posted by "Santhosh Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Santhosh Srinivasan resolved PIG-647.
-------------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Patch has been committed.
> memory sized passed on pig command line does not get propagated to JobConf
> --------------------------------------------------------------------------
>
> Key: PIG-647
> URL: https://issues.apache.org/jira/browse/PIG-647
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Santhosh Srinivasan
> Attachments: PIG-647.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-647) memory sized passed on pig command line
does not get propagated to JobConf
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668374#action_12668374 ]
Arun C Murthy commented on PIG-647:
-----------------------------------
Can we consider using org.apache.hadoop.uti.Tool (http://hadoop.apache.org/core/docs/r0.18.2/mapred_tutorial.html#Tool) ? You'd get all this for free...
> memory sized passed on pig command line does not get propagated to JobConf
> --------------------------------------------------------------------------
>
> Key: PIG-647
> URL: https://issues.apache.org/jira/browse/PIG-647
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Santhosh Srinivasan
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-647) memory sized passed on pig command line
does not get propagated to JobConf
Posted by "Santhosh Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Santhosh Srinivasan updated PIG-647:
------------------------------------
Attachment: PIG-647.patch
Attached patch fixes the issue with not passing the command line parameters to job configuration. The root cause of the issue was not overriding HOD's parameters with the command line parameters. There are no unit test cases as HOD testing is not covered in unit tests. Manual tests were performed to verify the fix.
> memory sized passed on pig command line does not get propagated to JobConf
> --------------------------------------------------------------------------
>
> Key: PIG-647
> URL: https://issues.apache.org/jira/browse/PIG-647
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Santhosh Srinivasan
> Attachments: PIG-647.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-647) memory sized passed on pig command line
does not get propagated to JobConf
Posted by "Santhosh Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668748#action_12668748 ]
Santhosh Srinivasan commented on PIG-647:
-----------------------------------------
All unit tests passed.
> memory sized passed on pig command line does not get propagated to JobConf
> --------------------------------------------------------------------------
>
> Key: PIG-647
> URL: https://issues.apache.org/jira/browse/PIG-647
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Santhosh Srinivasan
> Attachments: PIG-647.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (PIG-647) memory sized passed on pig command line
does not get propagated to JobConf
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich reassigned PIG-647:
----------------------------------
Assignee: Santhosh Srinivasan
> memory sized passed on pig command line does not get propagated to JobConf
> --------------------------------------------------------------------------
>
> Key: PIG-647
> URL: https://issues.apache.org/jira/browse/PIG-647
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Santhosh Srinivasan
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.