You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Chun Chang (JIRA)" <ji...@apache.org> on 2017/06/28 23:29:00 UTC
[jira] [Created] (DRILL-5617) spill filename conflict
Chun Chang created DRILL-5617:
---------------------------------
Summary: spill filename conflict
Key: DRILL-5617
URL: https://issues.apache.org/jira/browse/DRILL-5617
Project: Apache Drill
Issue Type: Bug
Components: Functions - Drill
Affects Versions: 1.11.0
Reporter: Chun Chang
Assignee: Boaz Ben-Zvi
Spill location can be configured to be written on hdfs such as:
hashagg: {
# The partitions divide the work inside the hashagg, to ease
# handling spilling. This initial figure is tuned down when
# memory is limited.
# Setting this option to 1 disables spilling !
num_partitions: 32,
spill: {
# The 2 options below override the common ones
# they should be deprecated in the future
directories : [ "/tmp/drill/spill" ],
fs : "maprfs:///"
}
}
However, this could cause spill filename conflict since name convention does not contain node name.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)