[jira] [Updated] (TAJO-292) Too many intermediate partition files

["Jinho Kim (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TAJO-292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jinho Kim updated TAJO-292:
---------------------------

    Attachment: TAJO-292.patch

In addition, I've added clean up the temporary directories.
* Clean up the all temporary directories at cluster starting.
** tajo.worker.start.cleanup [default=false]
* Automate clean up the query intermediate file

> Too many intermediate partition files
> -------------------------------------
>
>                 Key: TAJO-292
>                 URL: https://issues.apache.org/jira/browse/TAJO-292
>             Project: Tajo
>          Issue Type: Bug
>          Components: repartitioning
>            Reporter: Hyunsik Choi
>            Assignee: Jinho Kim
>            Priority: Critical
>             Fix For: 0.8-incubating
>
>         Attachments: TAJO-292.patch
>
>
> Unlike the before, the number of partitions are being currently determined by the volume size and the number of distinct keys. It can cause unnecessary overheads. We need to improve the partition number determiner to consider the number of cluster nodes.



--
This message was sent by Atlassian JIRA
(v6.1#6144)