[jira] [Created] (TAJO-1049) Remove the parallel degree limit up to the maximum cluster capacity

["Hyunsik Choi (JIRA)" <ji...@apache.org>]

Hyunsik Choi created TAJO-1049:
----------------------------------

             Summary: Remove the parallel degree limit up to the maximum cluster capacity
                 Key: TAJO-1049
                 URL: https://issues.apache.org/jira/browse/TAJO-1049
             Project: Tajo
          Issue Type: Improvement
          Components: data shuffle, distributed query plan
            Reporter: Hyunsik Choi
            Assignee: Hyunsik Choi
            Priority: Trivial
             Fix For: 0.9.0


The maximum parallel degree had been limited by the number of cluster node capacity. This was because the old hash shuffle approach created too many small files depending on the number of parallel degree of a stage.

But, TAJO-992 solved this problem. We don't need to use this limit anymore. This patch removes the limit.

I think that this patch requires cluster test and it is hard to verify this patch in unit tests.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)