You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Paul Rogers (JIRA)" <ji...@apache.org> on 2017/08/17 03:35:01 UTC
[jira] [Resolved] (DRILL-5617) Spill file name collisions when
spill file is on a shared file system
[ https://issues.apache.org/jira/browse/DRILL-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Rogers resolved DRILL-5617.
--------------------------------
Resolution: Fixed
Fix Version/s: 1.12.0
> Spill file name collisions when spill file is on a shared file system
> ---------------------------------------------------------------------
>
> Key: DRILL-5617
> URL: https://issues.apache.org/jira/browse/DRILL-5617
> Project: Apache Drill
> Issue Type: Bug
> Components: Functions - Drill
> Affects Versions: 1.11.0
> Reporter: Chun Chang
> Assignee: Paul Rogers
> Fix For: 1.12.0
>
>
> Spill location can be configured to be written on hdfs such as:
> hashagg: {
> # The partitions divide the work inside the hashagg, to ease
> # handling spilling. This initial figure is tuned down when
> # memory is limited.
> # Setting this option to 1 disables spilling !
> num_partitions: 32,
> spill: {
> # The 2 options below override the common ones
> # they should be deprecated in the future
> directories : [ "/tmp/drill/spill" ],
> fs : "maprfs:///"
> }
> }
> However, this could cause spill filename conflict since name convention does not contain node name.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)