You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Paul Rogers (JIRA)" <ji...@apache.org> on 2016/11/09 17:02:58 UTC

[jira] [Updated] (DRILL-5012) External Sort Batch does not check free disk space before writing

     [ https://issues.apache.org/jira/browse/DRILL-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Paul Rogers updated DRILL-5012:
-------------------------------
    Summary: External Sort Batch does not check free disk space before writing  (was: External Sort Batch does not check free space before writing)

> External Sort Batch does not check free disk space before writing
> -----------------------------------------------------------------
>
>                 Key: DRILL-5012
>                 URL: https://issues.apache.org/jira/browse/DRILL-5012
>             Project: Apache Drill
>          Issue Type: Bug
>    Affects Versions: 1.8.0
>            Reporter: Paul Rogers
>            Priority: Minor
>
> The ExternalSortBatch operator sorts data and spills to disk to control memory usage. The ESB accepts a configured set of output directories.
> The ESB does not check if sufficient space is available in a directory before writing to it; ESB requires that the admin ensure space is available.
> Desired fix: skip a directory if it does not contain space to hold the target spill file. (That is, write to the other directories if that have space.)
> The fix is not fail-safe: two threads may both check and both write. However, the fix reduces the chances of an out-of-disk error for the most obvious cases.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)