You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Abhishek Girish (JIRA)" <ji...@apache.org> on 2015/06/25 03:39:04 UTC

[jira] [Created] (DRILL-3365) Query with window function on large dataset fails with "IOException: Mkdirs failed to create spill directory"

Abhishek Girish created DRILL-3365:
--------------------------------------

             Summary: Query with window function on large dataset fails with "IOException: Mkdirs failed to create spill directory"
                 Key: DRILL-3365
                 URL: https://issues.apache.org/jira/browse/DRILL-3365
             Project: Apache Drill
          Issue Type: Bug
          Components: Execution - Flow
    Affects Versions: 1.1.0
            Reporter: Abhishek Girish
            Assignee: Chris Westin
            Priority: Minor


Dataset: TPC-DS SF100 Parquet

Query: 
{code:sql}
SELECT sum(ss.ss_net_paid_inc_tax) OVER (PARTITION BY ss.ss_store_sk ORDER BY ss.ss_customer_sk) AS PartialSum FROM store_sales ss GROUP BY ss.ss_net_paid_inc_tax, ss.ss_store_sk, ss.ss_customer_sk  LIMIT 20;
java.lang.RuntimeException: java.sql.SQLException: SYSTEM ERROR: java.io.IOException: Mkdirs failed to create /tmp/drill/spill/2a74ac18-0679-ab99-26c6-af41b9af7f4e/major_fragment_1/minor_fragment_17/operator_4 (exists=false, cwd=file:///opt/mapr/drill/drill-1.1.0/bin)
Fragment 1:17
[Error Id: 4905b400-fc0f-4287-beba-d1ca18359986 on abhi5.qa.lab:31010]
	at sqlline.IncrementalRows.hasNext(IncrementalRows.java:73)
	at sqlline.TableOutputFormat$ResizingRowsProvider.next(TableOutputFormat.java:85)
	at sqlline.TableOutputFormat.print(TableOutputFormat.java:116)
	at sqlline.SqlLine.print(SqlLine.java:1583)
	at sqlline.Commands.execute(Commands.java:852)
	at sqlline.Commands.sql(Commands.java:751)
	at sqlline.SqlLine.dispatch(SqlLine.java:738)
	at sqlline.SqlLine.begin(SqlLine.java:612)
	at sqlline.SqlLine.start(SqlLine.java:366)
	at sqlline.SqlLine.main(SqlLine.java:259)
{code}

Was unable to find corresponding logs. This was consistently seen via JDBC program and sqlline. 

After I restarted Drillbits the issue seems to have been resolved. But wanted to report this anyway. Possible explanation is DRILL-2917 (one or more drillbits were in an inconsistent state)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)