You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Gunther Hagleitner (JIRA)" <ji...@apache.org> on 2013/08/30 01:33:52 UTC
[jira] [Resolved] (HIVE-5095) Hive needs new operator walker for
parallelization/optimization for tez
[ https://issues.apache.org/jira/browse/HIVE-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gunther Hagleitner resolved HIVE-5095.
--------------------------------------
Resolution: Fixed
> Hive needs new operator walker for parallelization/optimization for tez
> -----------------------------------------------------------------------
>
> Key: HIVE-5095
> URL: https://issues.apache.org/jira/browse/HIVE-5095
> Project: Hive
> Issue Type: Bug
> Components: Tez
> Affects Versions: tez-branch
> Reporter: Vikram Dixit K
> Assignee: Vikram Dixit K
> Fix For: tez-branch
>
> Attachments: HIVE-5095.1.patch, HIVE-5095.WIP.patch.txt
>
>
> For tez to compute the number of reducers, we should be walking the operator tree in a topological fashion so that the reducers down the tree get the estimate from all parents. However, the current walkers in hive only walk the operator tree in a depth-first fashion. We need to add a new walker for the topological walk. Also, since information about the parent operators needs to be propagated on a per parent basis, we need to retain some context across operators to be passed to the child which the walker will co-ordinate.
> NO PRECOMMIT TESTS (this is wip for the tez branch)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira