You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Robert Hou (JIRA)" <ji...@apache.org> on 2017/08/30 21:02:00 UTC

[jira] [Assigned] (DRILL-5617) Spill file name collisions when spill file is on a shared file system

     [ https://issues.apache.org/jira/browse/DRILL-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Hou reassigned DRILL-5617:
---------------------------------

    Assignee: Chun Chang  (was: Paul Rogers)

> Spill file name collisions when spill file is on a shared file system
> ---------------------------------------------------------------------
>
>                 Key: DRILL-5617
>                 URL: https://issues.apache.org/jira/browse/DRILL-5617
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Functions - Drill
>    Affects Versions: 1.11.0
>            Reporter: Chun Chang
>            Assignee: Chun Chang
>             Fix For: 1.12.0
>
>
> Spill location can be configured to be written on hdfs such as:
>   hashagg: {
>     # The partitions divide the work inside the hashagg, to ease
>     # handling spilling. This initial figure is tuned down when
>     # memory is limited.
>     #  Setting this option to 1 disables spilling !
>     num_partitions: 32,
>     spill: {
>         # The 2 options below override the common ones
>         # they should be deprecated in the future
>         directories : [ "/tmp/drill/spill" ],
>         fs : "maprfs:///"
>      }
>   }
> However, this could cause spill filename conflict since name convention does not contain node name.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)