You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2014/02/07 00:41:23 UTC

[jira] [Commented] (PIG-3742) Set MR runtime settings on tez runtime

    [ https://issues.apache.org/jira/browse/PIG-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13893987#comment-13893987 ] 

Rohini Palaniswamy commented on PIG-3742:
-----------------------------------------

This patch also creates the tez staging directory under Pig temporary directory so that it gets cleaned up and we don't have to wait for TEZ-793.

> Set MR runtime settings on tez runtime
> --------------------------------------
>
>                 Key: PIG-3742
>                 URL: https://issues.apache.org/jira/browse/PIG-3742
>             Project: Pig
>          Issue Type: Sub-task
>          Components: tez
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: tez-branch
>
>         Attachments: PIG-3742-3.patch
>
>
> Classify whether a vertex is a map or reduce and set java.opts (mapreduce.map.java.opts or mapreduce.reduce.java.opts), memory.mb (mapreduce.map.memory.mb or mapreduce.reduce.memory.mb) and env (mapreduce.map.env or mapreduce.reduce.env) accordingly on the vertex. A simple thing would be to assume all root vertexes to be map vertexes and intermediate or leaf vertexes to be reduce vertexes.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)