You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Abhishek Girish (JIRA)" <ji...@apache.org> on 2017/03/08 00:08:37 UTC

[jira] [Updated] (DRILL-3365) Query with window function on large dataset fails with "IOException: Mkdirs failed to create spill directory"

     [ https://issues.apache.org/jira/browse/DRILL-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Abhishek Girish updated DRILL-3365:
-----------------------------------
    Priority: Major  (was: Minor)

> Query with window function on large dataset fails with "IOException: Mkdirs failed to create spill directory"
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: DRILL-3365
>                 URL: https://issues.apache.org/jira/browse/DRILL-3365
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Flow
>    Affects Versions: 1.1.0
>            Reporter: Abhishek Girish
>             Fix For: Future
>
>
> Dataset: TPC-DS SF100 Parquet
> Query: 
> {code:sql}
> SELECT sum(ss.ss_net_paid_inc_tax) OVER (PARTITION BY ss.ss_store_sk ORDER BY ss.ss_customer_sk) AS PartialSum FROM store_sales ss GROUP BY ss.ss_net_paid_inc_tax, ss.ss_store_sk, ss.ss_customer_sk  LIMIT 20;
> java.lang.RuntimeException: java.sql.SQLException: SYSTEM ERROR: java.io.IOException: Mkdirs failed to create /tmp/drill/spill/2a74ac18-0679-ab99-26c6-af41b9af7f4e/major_fragment_1/minor_fragment_17/operator_4 (exists=false, cwd=file:///opt/mapr/drill/drill-1.1.0/bin)
> Fragment 1:17
> [Error Id: 4905b400-fc0f-4287-beba-d1ca18359986 on abhi5.qa.lab:31010]
> 	at sqlline.IncrementalRows.hasNext(IncrementalRows.java:73)
> 	at sqlline.TableOutputFormat$ResizingRowsProvider.next(TableOutputFormat.java:85)
> 	at sqlline.TableOutputFormat.print(TableOutputFormat.java:116)
> 	at sqlline.SqlLine.print(SqlLine.java:1583)
> 	at sqlline.Commands.execute(Commands.java:852)
> 	at sqlline.Commands.sql(Commands.java:751)
> 	at sqlline.SqlLine.dispatch(SqlLine.java:738)
> 	at sqlline.SqlLine.begin(SqlLine.java:612)
> 	at sqlline.SqlLine.start(SqlLine.java:366)
> 	at sqlline.SqlLine.main(SqlLine.java:259)
> {code}
> Was unable to find corresponding logs. This was consistently seen via JDBC program and sqlline. 
> After I restarted Drillbits the issue seems to have been resolved. But wanted to report this anyway. Possible explanation is DRILL-2917 (one or more drillbits were in an inconsistent state)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)