You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Abhishek Girish (JIRA)" <ji...@apache.org> on 2015/02/02 04:36:34 UTC

[jira] [Created] (DRILL-2138) Failure while querying MapR-DB Views/Tables

Abhishek Girish created DRILL-2138:
--------------------------------------

             Summary: Failure while querying MapR-DB Views/Tables
                 Key: DRILL-2138
                 URL: https://issues.apache.org/jira/browse/DRILL-2138
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 0.8.0
            Reporter: Abhishek Girish
            Priority: Critical


I'm hitting an issue while querying views on top of MapR-DB tables. Issuing a simple select * on any one of the views succeeds after which any subsequent query fails, irrespective of the schema. 

> select * from customer limit 1;
+------------+------------+------------+-------------+------------+------------+--------------+------------+
| c_custkey  |   c_name   | c_address  | c_nationkey |  c_phone   | c_acctbal  | c_mktsegment | c_comment  |
+------------+------------+------------+-------------+------------+------------+--------------+------------+
| 1          | Customer#000000001 | IVhzIApeRb ot,c,E | 15          | 25-989-741-2988 | 711.56     | BUILDING     | to the even, regular platelets. regular, ironic epitaphs nag e |
+------------+------------+------------+-------------+------------+------------+--------------+------------+
1 row selected (1.113 seconds)

> select * from customer limit 1;
Query failed: SqlValidatorException: Table 'customer' not found
Error: exception while executing query: Failure while executing query. (state=,code=0)

> use dfs.tmp;
+------------+------------+
|     ok     |  summary   |
+------------+------------+
| true       | Default schema changed to 'dfs.tmp' |
+------------+------------+
1 row selected (0.179 seconds)

> show files;
Query failed: IOException: Filesystem closed
Error: exception while executing query: Failure while executing query. (state=,code=0)

Log:

2015-02-01 18:39:29,437 [2b311c9e-2130-ead7-d1bc-df1148f48cff:foreman] INFO  o.a.drill.exec.work.foreman.Foreman - State change requested.  PENDING --> FAILED
org.apache.drill.exec.planner.sql.QueryInputException: Failure handling SQL.
        at org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:149) ~[drill-java-exec-0.7.0-r3-SNAPSHOT-rebuffed.jar:0.7.0-r3-SNAPSHOT]
      ...
Caused by: java.io.IOException: Filesystem closed
        at com.mapr.fs.MapRFileSystem.checkOpen(MapRFileSystem.java:1359) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at com.mapr.fs.MapRFileSystem.lookupClient(MapRFileSystem.java:481) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at com.mapr.fs.MapRFileSystem.lookupClient(MapRFileSystem.java:567) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at com.mapr.fs.MapRFileSystem.listMapRStatus(MapRFileSystem.java:1276) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at com.mapr.fs.MapRFileSystem.listStatus(MapRFileSystem.java:1334) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at com.mapr.fs.MapRFileSystem.listStatus(MapRFileSystem.java:66) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1519) ~[hadoop-common-2.4.1-mapr-1408.jar:na]
        ...
...
2015-02-01 18:39:29,443 [2b311c9e-2130-ead7-d1bc-df1148f48cff:foreman] ERROR o.a.drill.exec.work.foreman.Foreman - Error e55832c9-35a8-4287-9eb4-758b1b241cb1: IOException: Filesystem closed
org.apache.drill.exec.planner.sql.QueryInputException: Failure handling SQL.
        at org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:149) ~[drill-java-exec-0.7.0-r3-SNAPSHOT-rebuffed.jar:0.7.0-r3-SNAPSHOT]
        ...
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
Caused by: java.io.IOException: Filesystem closed
        at com.mapr.fs.MapRFileSystem.checkOpen(MapRFileSystem.java:1359) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at com.mapr.fs.MapRFileSystem.lookupClient(MapRFileSystem.java:481) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at com.mapr.fs.MapRFileSystem.lookupClient(MapRFileSystem.java:567) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at com.mapr.fs.MapRFileSystem.listMapRStatus(MapRFileSystem.java:1276) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at com.mapr.fs.MapRFileSystem.listStatus(MapRFileSystem.java:1334) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at com.mapr.fs.MapRFileSystem.listStatus(MapRFileSystem.java:66) ~[maprfs-4.0.1.28318-mapr.jar:4.0.1.28318-mapr]
        at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1519) ~[hadoop-common-2.4.1-mapr-1408.jar:na]
       ...
2015-02-01 18:39:29,443 [2b311c9e-2130-ead7-d1bc-df1148f48cff:foreman] INFO  o.a.drill.exec.work.foreman.Foreman - foreman cleaning up - status: []

I just verified that the issue is not observed on Drill 0.6, 0.7-r2. It is observed on Drill 0.7-R3 & Drill 0.8 (Have logs from each run for reference)

Also, on Drill 0.7-R3 (& Drill 0.8), the issue is not observed when i query any regular json/text/parquet files. This is seen only when I query any MapR-DB table /view. After which I cannot query any file on any schema. On restarting drill-bits, I can begin querying other schemas.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)