[GitHub] drill issue #585: DRILL-3898 : Sort spill was modified to catch all errors, ...

[Ben-Zvi <gi...@git.apache.org>]

Github user Ben-Zvi commented on the issue:

    https://github.com/apache/drill/pull/585
  
    Below are results from testing; first run with not enough disk space, and the second with a missing storage for the spill:
    
    0: jdbc:drill:zk=local> create table store_sales_20(ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, s_sold_date_sk, ss_promo_sk) partition by (ss_promo_sk) as
    . . . . . . . . . . . >  select
    . . . . . . . . . . . >    case when columns[2] = '' then cast(null as varchar(100)) else cast(columns[2] as varchar(100)) end,
    . . . . . . . . . . . >    case when columns[3] = '' then cast(null as varchar(100)) else cast(columns[3] as varchar(100)) end,
    . . . . . . . . . . . >    case when columns[4] = '' then cast(null as varchar(100)) else cast(columns[4] as varchar(100)) end, 
    . . . . . . . . . . . >    case when columns[5] = '' then cast(null as varchar(100)) else cast(columns[5] as varchar(100)) end, 
    . . . . . . . . . . . >    case when columns[0] = '' then cast(null as varchar(100)) else cast(columns[0] as varchar(100)) end, 
    . . . . . . . . . . . >    case when columns[8] = '' then cast(null as varchar(100)) else cast(columns[8] as varchar(100)) end
    . . . . . . . . . . . > FROM dfs.`/Users/boazben-zvi/data/store_sales/store_sales.dat`;
    Error: RESOURCE ERROR: External Sort encountered an error while spilling to disk
    
    java.io.IOException: No space left on device
    Fragment 0:0
    
    [Error Id: 35d13ef6-f88a-4a80-9f5e-ddb15efc9d92 on 10.250.57.63:31010] (state=,code=0)
    0: jdbc:drill:zk=local> create table store_sales_20(ss_item_sk, ss_customer_sk, ss_cdemo_sk, ss_hdemo_sk, s_sold_date_sk, ss_promo_sk) partition by (ss_promo_sk) as
    . . . . . . . . . . . >  select
    . . . . . . . . . . . >    case when columns[2] = '' then cast(null as varchar(100)) else cast(columns[2] as varchar(100)) end,
    . . . . . . . . . . . >    case when columns[3] = '' then cast(null as varchar(100)) else cast(columns[3] as varchar(100)) end,
    . . . . . . . . . . . >    case when columns[4] = '' then cast(null as varchar(100)) else cast(columns[4] as varchar(100)) end, 
    . . . . . . . . . . . >    case when columns[5] = '' then cast(null as varchar(100)) else cast(columns[5] as varchar(100)) end, 
    . . . . . . . . . . . >    case when columns[0] = '' then cast(null as varchar(100)) else cast(columns[0] as varchar(100)) end, 
    . . . . . . . . . . . >    case when columns[8] = '' then cast(null as varchar(100)) else cast(columns[8] as varchar(100)) end
    . . . . . . . . . . . > FROM dfs.`/Users/boazben-zvi/data/store_sales/store_sales.dat`;
    Error: RESOURCE ERROR: External Sort encountered an error while spilling to disk
    
    Mkdirs failed to create /tmp/drill/spill/282cbdbc-630a-2218-3871-165491f5e96c_majorfragment0_minorfragment0_operator6 (exists=false, cwd=file:/Users/boazben-zvi/IdeaProjects/drill)
    Fragment 0:0
    
    [Error Id: dea8b3fd-9661-48b5-9a3c-11d2dadf8f07 on 10.250.57.63:31010] (state=,code=0)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---