You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Brock Noland (JIRA)" <ji...@apache.org> on 2014/10/29 19:20:33 UTC

[jira] [Created] (HIVE-8649) Increase level of parallelism

Brock Noland created HIVE-8649:
----------------------------------

             Summary: Increase level of parallelism
                 Key: HIVE-8649
                 URL: https://issues.apache.org/jira/browse/HIVE-8649
             Project: Hive
          Issue Type: Sub-task
            Reporter: Brock Noland


We calculate the number of reducers based on the same code for MapReduce. However, reducers are vastly cheaper in Spark and it's generally recommended we have many more reducers than in MR.

Sandy Ryza who works on Spark has some ideas about a heuristic.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)