You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Paul Rogers (JIRA)" <ji...@apache.org> on 2016/11/08 17:58:58 UTC

[jira] [Created] (DRILL-5012) External Sort Batch does not check free space before writing

Paul Rogers created DRILL-5012:
----------------------------------

             Summary: External Sort Batch does not check free space before writing
                 Key: DRILL-5012
                 URL: https://issues.apache.org/jira/browse/DRILL-5012
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.8.0
            Reporter: Paul Rogers
            Priority: Minor


The ExternalSortBatch operator sorts data and spills to disk to control memory usage. The ESB accepts a configured set of output directories.

The ESB does not check if sufficient space is available in a directory before writing to it; ESB requires that the admin ensure space is available.

Desired fix: skip a directory if it does not contain space to hold the target spill file. (That is, write to the other directories if that have space.)

The fix is not fail-safe: two threads may both check and both write. However, the fix reduces the chances of an out-of-disk error for the most obvious cases.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)