You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tajo.apache.org by "Jinho Kim (JIRA)" <ji...@apache.org> on 2013/12/05 08:40:38 UTC

[jira] [Comment Edited] (TAJO-292) Too many intermediate partition files

    [ https://issues.apache.org/jira/browse/TAJO-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13839913#comment-13839913 ] 

Jinho Kim edited comment on TAJO-292 at 12/5/13 7:40 AM:
---------------------------------------------------------

I've uploaded the patch that reflects your comment.
verified TPC-H 1, 3, 10. please review this. thanks


was (Author: jhkim):
I've uploaded the patch that reflects your comment.
please review this. thanks

> Too many intermediate partition files
> -------------------------------------
>
>                 Key: TAJO-292
>                 URL: https://issues.apache.org/jira/browse/TAJO-292
>             Project: Tajo
>          Issue Type: Bug
>          Components: repartitioning
>    Affects Versions: 0.2-incubating
>            Reporter: Hyunsik Choi
>            Assignee: Jinho Kim
>            Priority: Critical
>             Fix For: 0.8-incubating
>
>         Attachments: TAJO-292.patch, TAJO-292_2.patch, TAJO-292_3.patch
>
>
> Unlike the before, the number of partitions are being currently determined by the volume size and the number of distinct keys. It can cause unnecessary overheads. We need to improve the partition number determiner to consider the number of cluster nodes.



--
This message was sent by Atlassian JIRA
(v6.1#6144)