You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Paul Rogers (JIRA)" <ji...@apache.org> on 2017/06/29 02:40:00 UTC

[jira] [Updated] (DRILL-5617) Spill file name collisions when spill file is on a shared file system

     [ https://issues.apache.org/jira/browse/DRILL-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Paul Rogers updated DRILL-5617:
-------------------------------
    Summary: Spill file name collisions when spill file is on a shared file system  (was: spill filename conflict)

> Spill file name collisions when spill file is on a shared file system
> ---------------------------------------------------------------------
>
>                 Key: DRILL-5617
>                 URL: https://issues.apache.org/jira/browse/DRILL-5617
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Functions - Drill
>    Affects Versions: 1.11.0
>            Reporter: Chun Chang
>            Assignee: Paul Rogers
>
> Spill location can be configured to be written on hdfs such as:
>   hashagg: {
>     # The partitions divide the work inside the hashagg, to ease
>     # handling spilling. This initial figure is tuned down when
>     # memory is limited.
>     #  Setting this option to 1 disables spilling !
>     num_partitions: 32,
>     spill: {
>         # The 2 options below override the common ones
>         # they should be deprecated in the future
>         directories : [ "/tmp/drill/spill" ],
>         fs : "maprfs:///"
>      }
>   }
> However, this could cause spill filename conflict since name convention does not contain node name.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)