You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Chun Chang (JIRA)" <ji...@apache.org> on 2017/06/28 23:29:00 UTC

[jira] [Created] (DRILL-5617) spill filename conflict

Chun Chang created DRILL-5617:
---------------------------------

             Summary: spill filename conflict
                 Key: DRILL-5617
                 URL: https://issues.apache.org/jira/browse/DRILL-5617
             Project: Apache Drill
          Issue Type: Bug
          Components: Functions - Drill
    Affects Versions: 1.11.0
            Reporter: Chun Chang
            Assignee: Boaz Ben-Zvi


Spill location can be configured to be written on hdfs such as:

  hashagg: {
    # The partitions divide the work inside the hashagg, to ease
    # handling spilling. This initial figure is tuned down when
    # memory is limited.
    #  Setting this option to 1 disables spilling !
    num_partitions: 32,
    spill: {
        # The 2 options below override the common ones
        # they should be deprecated in the future
        directories : [ "/tmp/drill/spill" ],
        fs : "maprfs:///"
     }
  }

However, this could cause spill filename conflict since name convention does not contain node name.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)