[jira] [Commented] (HIVE-5052) Set parallelism when generating the tez tasks

["Gunther Hagleitner (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13739452#comment-13739452 ] 

Gunther Hagleitner commented on HIVE-5052:
------------------------------------------

RB?

- next power of two in java can be done in a simpler way: 
{code}
j = Integer.higestOneBit(i);
i==j return i : j<<1;
{code}

- We shouldn't change the default for BYTESPERREDUCER. If we want a different default for TEZ we should probably create a different var.
- The comment should mention what happens with multi parent reduce-work
- There seems to be some dead code at the end of the file
- The setting of the var can be broken into separate method in the class
- If the reducesink specifies a specific number of reducers, do we need to carry that number through additional stages? Right now you will add other stuff to it during the walk.
                
> Set parallelism when generating the tez tasks
> ---------------------------------------------
>
>                 Key: HIVE-5052
>                 URL: https://issues.apache.org/jira/browse/HIVE-5052
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Gunther Hagleitner
>            Assignee: Vikram Dixit K
>             Fix For: tez-branch
>
>         Attachments: HIVE-5052.1.patch.txt, HIVE-5052.2.patch.txt
>
>
> In GenTezTask any intermediate task has parallelism set to 1. This needs to be fixed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira