You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2015/10/10 11:21:05 UTC

[jira] [Commented] (DRILL-3917) IllegalArgumentException when running query after creating metadata cache

    [ https://issues.apache.org/jira/browse/DRILL-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951741#comment-14951741 ] 

ASF GitHub Bot commented on DRILL-3917:
---------------------------------------

GitHub user amansinha100 opened a pull request:

    https://github.com/apache/drill/pull/195

    DRILL-3917: During file selection expansion, get the metadata for the…

    … directory by reading the metadata file.
    
    Ensure the selection root format is the same as the format of the files.
    Add unit test.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/amansinha100/incubator-drill refresh_metadata_bugs_1

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/drill/pull/195.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #195
    
----
commit 3649374ff99432afe40e28b1acc347e31324d79f
Author: Aman Sinha <as...@maprtech.com>
Date:   2015-10-10T09:18:40Z

    DRILL-3917: During file selection expansion, get the metadata for the directory by reading the metadata file.
    Ensure the selection root format is the same as the format of the files.
    Add unit test.

----


> IllegalArgumentException when running query after creating metadata cache
> -------------------------------------------------------------------------
>
>                 Key: DRILL-3917
>                 URL: https://issues.apache.org/jira/browse/DRILL-3917
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Metadata
>            Reporter: Aman Sinha
>            Assignee: Aman Sinha
>         Attachments: orders.tar
>
>
> I am getting an error with the below query:
> Without metadata cache: 
> {code}
> 0: jdbc:drill:zk=local> select count(*) from orders where dir0 = 1995;
> +---------+
> | EXPR$0  |
> +---------+
> | 40      |
> +---------+
> 1 row selected (0.205 seconds)
> {code}
> Create metadata cache and run query: 
> {code}
> 0: jdbc:drill:zk=local> refresh table metadata `orders`;
> +-------+--------------------------------------------------+
> |  ok   |                     summary                      |
> +-------+--------------------------------------------------+
> | true  | Successfully updated metadata for table orders.  |
> +-------+--------------------------------------------------+
> 1 row selected (1.112 seconds)
> 0: jdbc:drill:zk=local> select count(*) from orders where dir0 = 1995;
> Error: SYSTEM ERROR: IllegalArgumentException: MinorFragmentId 0 has no read entries assigned
> [Error Id: c1cd004c-8850-47fb-8cd8-6da85dd4fc50 on 172.16.0.160:31010]
>   (org.apache.drill.exec.work.foreman.ForemanException) Unexpected exception during fragment initialization: MinorFragmentId 0 has no read entries assigned
>     org.apache.drill.exec.work.foreman.Foreman.run():255
>     java.util.concurrent.ThreadPoolExecutor.runWorker():1145
>     java.util.concurrent.ThreadPoolExecutor$Worker.run():615
>     java.lang.Thread.run():744
>   Caused By (java.lang.IllegalArgumentException) MinorFragmentId 0 has no read entries assigned
>     com.google.common.base.Preconditions.checkArgument():92
>     org.apache.drill.exec.store.parquet.ParquetGroupScan.getSpecificScan():679
>     org.apache.drill.exec.store.parquet.ParquetGroupScan.getSpecificScan():103
>     org.apache.drill.exec.planner.fragment.Materializer.visitGroupScan():68
>     org.apache.drill.exec.planner.fragment.Materializer.visitGroupScan():35
>     org.apache.drill.exec.physical.base.AbstractGroupScan.accept():60
>     org.apache.drill.exec.planner.fragment.Materializer.visitOp():102
>     org.apache.drill.exec.planner.fragment.Materializer.visitOp():35
>     org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitProject():77
>     org.apache.drill.exec.physical.config.Project.accept():51
>     org.apache.drill.exec.planner.fragment.Materializer.visitOp():102
>     org.apache.drill.exec.planner.fragment.Materializer.visitOp():35
>     org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitStreamingAggregate():97
>     org.apache.drill.exec.physical.config.StreamingAggregate.accept():58
>     org.apache.drill.exec.planner.fragment.Materializer.visitOp():102
>     org.apache.drill.exec.planner.fragment.Materializer.visitOp():35
>     org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitProject():77
>     org.apache.drill.exec.physical.config.Project.accept():51
>     org.apache.drill.exec.planner.fragment.Materializer.visitStore():82
>     org.apache.drill.exec.planner.fragment.Materializer.visitStore():35
>     org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitScreen():195
>     org.apache.drill.exec.physical.config.Screen.accept():97
>     org.apache.drill.exec.planner.fragment.SimpleParallelizer.generateWorkUnit():355
>   org.apache.drill.exec.planner.fragment.SimpleParallelizer.getFragments():134
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)