You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Boaz Ben-Zvi (JIRA)" <ji...@apache.org> on 2018/02/06 02:25:00 UTC
[jira] [Comment Edited] (DRILL-6137) Join Failure When Some Json
File Partitions Empty
[ https://issues.apache.org/jira/browse/DRILL-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353241#comment-16353241 ]
Boaz Ben-Zvi edited comment on DRILL-6137 at 2/6/18 2:24 AM:
-------------------------------------------------------------
May need to force a parallel plan to recreate this failure
{code:java}
set `planner.slice_target`=1;{code}
was (Author: ben-zvi):
May need to force a parallel plan to recreate this failure
```
set `planner.slice_target`=1;
```
> Join Failure When Some Json File Partitions Empty
> -------------------------------------------------
>
> Key: DRILL-6137
> URL: https://issues.apache.org/jira/browse/DRILL-6137
> Project: Apache Drill
> Issue Type: Bug
> Reporter: Timothy Farkas
> Assignee: Timothy Farkas
> Priority: Major
>
> The following exception can occurr when the following query is executed:
> {code}
> select t.p_partkey, t1.ps_suppkey from dfs.`join/empty_part/part` as t RIGHT JOIN dfs.`join/empty_part/partsupp` as t1 ON t.p_partkey = t1.ps_partkey where t1.ps_partkey > 1
> {code}
> * part has one nonempty file 0_0_0.json
> * partsupp has one nonempty file 0_0_0.json and one empty file 0_0_1.json
> {code}
> (java.lang.IllegalStateException) next() [on #10, RemovingRecordBatch] called again after it returned NONE. Caller should not have called next() again.
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():220
> org.apache.drill.exec.record.AbstractRecordBatch.next():119
> org.apache.drill.exec.test.generated.HashJoinProbeGen2.executeProbePhase():119
> org.apache.drill.exec.test.generated.HashJoinProbeGen2.probeAndProject():227
> org.apache.drill.exec.physical.impl.join.HashJoinBatch.innerNext():222
> org.apache.drill.exec.record.AbstractRecordBatch.next():164
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():228
> org.apache.drill.exec.record.AbstractRecordBatch.next():119
> org.apache.drill.exec.record.AbstractRecordBatch.next():109
> org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
> org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():134
> org.apache.drill.exec.record.AbstractRecordBatch.next():164
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():228
> org.apache.drill.exec.record.AbstractRecordBatch.next():119
> org.apache.drill.exec.record.AbstractRecordBatch.next():109
> org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
> org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():134
> org.apache.drill.exec.record.AbstractRecordBatch.next():164
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():228
> org.apache.drill.exec.physical.impl.BaseRootExec.next():105
> org.apache.drill.exec.physical.impl.SingleSenderCreator$SingleSenderRootExec.innerNext():93
> org.apache.drill.exec.physical.impl.BaseRootExec.next():95
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():233
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():226
> java.security.AccessController.doPrivileged():-2
> javax.security.auth.Subject.doAs():415
> org.apache.hadoop.security.UserGroupInformation.doAs():1657
> org.apache.drill.exec.work.fragment.FragmentExecutor.run():226
> org.apache.drill.common.SelfCleaningRunnable.run():38
> java.util.concurrent.ThreadPoolExecutor.runWorker():1145
> java.util.concurrent.ThreadPoolExecutor$Worker.run():615
> java.lang.Thread.run():745
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)