You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Aman Sinha (JIRA)" <ji...@apache.org> on 2015/12/07 04:40:10 UTC

[jira] [Commented] (DRILL-4165) IllegalStateException in MergeJoin for a query against TPC-DS data

    [ https://issues.apache.org/jira/browse/DRILL-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044322#comment-15044322 ] 

Aman Sinha commented on DRILL-4165:
-----------------------------------

This query also fails on 1.3.0 with merge join  although the stack is slightly different:
{noformat}
0: jdbc:drill:zk=local> select count(*) from dfs.`/Users/asinha/data/tpcds/store_sales` ss1, dfs.`/Users/asinha/data/tpcds/store_sales` ss2 where ss1.ss_customer_sk = ss2.ss_customer_sk and ss1.ss_store_sk = 1 and ss2.ss_store_sk = 2;
Error: SYSTEM ERROR: IllegalArgumentException

  (java.lang.IllegalArgumentException) null
    com.google.common.base.Preconditions.checkArgument():76
    org.apache.drill.exec.record.RecordIterator.getCurrentPosition():242
    org.apache.drill.exec.test.generated.JoinWorkerGen15.doJoin():89
    org.apache.drill.exec.physical.impl.join.MergeJoinBatch.innerNext():206
{noformat}


> IllegalStateException in MergeJoin for a query against TPC-DS data
> ------------------------------------------------------------------
>
>                 Key: DRILL-4165
>                 URL: https://issues.apache.org/jira/browse/DRILL-4165
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Relational Operators
>    Affects Versions: 1.4.0
>            Reporter: Aman Sinha
>
> I am seeing the following on the 1.4.0 branch. 
> {noformat}
> 0: jdbc:drill:zk=local> alter session set `planner.enable_hashjoin` = false;
> ..
> 0: jdbc:drill:zk=local> select count(*) from dfs.`tpcds/store_sales` ss1, dfs.`tpcds/store_sales` ss2 where ss1.ss_customer_sk = ss2.ss_customer_sk and ss1.ss_store_sk = 1 and ss2.ss_store_sk = 2;
> Error: SYSTEM ERROR: IllegalStateException: Incoming batch [#55, MergeJoinBatch] has size 1984616, which is beyond the limit of 65536
> Fragment 0:0
> [Error Id: 18bf00fe-52d7-4d84-97ec-b04a035afb4e on 192.168.1.103:31010]
>   (java.lang.IllegalStateException) Incoming batch [#55, MergeJoinBatch] has size 1984616, which is beyond the limit of 65536
>     org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():305
>     org.apache.drill.exec.record.AbstractRecordBatch.next():119
>     org.apache.drill.exec.record.AbstractRecordBatch.next():109
>     org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
>     org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():132
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)