You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Bo Qiang <bo...@nielsen.com> on 2018/02/06 05:17:24 UTC

Apache drill validation error, table not found

I have been trying to use Apache drill to query data in s3 buckets. Inside
of Drill Explorer, I met the following errors:

    ERROR [HY000] [MapR][Drill] (1040) Drill failed to execute the query:
SELECT * FROM `s3`.`default`.`./data/part-r-001` LIMIT 100
    [30034]Query execution error. Details:[
    VALIDATION ERROR: From line 1, column 15 to line 1, column 18: Table
's3.default../data/part-r-001' not found

    SQL Query null

    [Error Id: fa18496f-038f-46b1-9d3f-c40809511768 on 10.23.58.220:31010]
    ]
       at System.Data.Odbc.OdbcConnection.HandleError(OdbcHandle hrHandle,
RetCode retcode)
       at System.Data.Odbc.OdbcCommand.ExecuteReaderObject(CommandBehavior
behavior, String method, Boolean needReader, Object[] methodArguments,
SQL_API odbcApiMethod)
       at System.Data.Odbc.OdbcCommand.ExecuteReaderObject(CommandBehavior
behavior, String method, Boolean needReader)
       at System.Data.Odbc.OdbcCommand.ExecuteReader(CommandBehavior
behavior)
       at DrillExplorer.DROdbcProvider.GetStatmentColumns(String in_query)

The part-r-001 file are of ORC format.

Is there anything fix? Thanks a lot!

Re: Apache drill validation error, table not found

Posted by Arjun kr <ar...@outlook.com>.
Is the failure due to ORC file not being supported by DFS/S3 plugin?  This error may come if you are querying on unsupported format or if you don't have the format defined in corresponding storage plugin definition.

Below is sample execution for junk format 'thenga' not defined in storage plugin definition.

$ hadoop fs -ls /tmp/sample.thenga
-rwxr-x---   3 manga manga         37 2017-10-16 16:31 /tmp/sample.thenga

$sqlline
0: jdbc:drill:schema=dfs> select * from dfs.`/tmp/sample.thenga`;
Error: [MapR][DrillJDBCDriver](500165) Query execution error: VALIDATION ERROR: From line 1, column 15 to line 1, column 17: Table 'dfs./tmp/sample.thenga' not found

SQL Query null

[Error Id: 154d6187-eea2-4afe-ab64-ac0f287a3433 on drill-node:31010] (state=HY000,code=500165)
0: jdbc:drill:schema=dfs>

One option would be to use Hive table built on top of these files and use hive storage plugin in Drill ( if hive table on top of S3 ORC files works fine). Or Parquet files would be a good choice with Drill.

Thanks,

Arjun

________________________________
From: Sorabh Hamirwasia <sh...@mapr.com>
Sent: Tuesday, February 6, 2018 1:11 PM
To: user@drill.apache.org
Subject: Re: Apache drill validation error, table not found

Hi,

Can you please try following instruction here [1] once.? Also after configuration you can try to list tables by "show databases" to make sure setup is fine.


And the query should be:

SELECT * FROM s3.`./data/part-r-001` LIMIT 100


[1]: https://drill.apache.org/docs/s3-storage-plugin/
S3 Storage Plugin - Apache Drill<https://drill.apache.org/docs/s3-storage-plugin/>
drill.apache.org
Drill works with data stored in the cloud. With a few simple steps, you can configure the S3 storage plugin for Drill and be off to the races running queries.





Thanks,
Sorabh


________________________________
From: Bo Qiang <bo...@nielsen.com>
Sent: Monday, February 5, 2018 9:17 PM
To: user@drill.apache.org
Subject: Apache drill validation error, table not found

I have been trying to use Apache drill to query data in s3 buckets. Inside
of Drill Explorer, I met the following errors:

    ERROR [HY000] [MapR][Drill] (1040) Drill failed to execute the query:
SELECT * FROM `s3`.`default`.`./data/part-r-001` LIMIT 100
    [30034]Query execution error. Details:[
    VALIDATION ERROR: From line 1, column 15 to line 1, column 18: Table
's3.default../data/part-r-001' not found

    SQL Query null

    [Error Id: fa18496f-038f-46b1-9d3f-c40809511768 on 10.23.58.220:31010]
    ]
       at System.Data.Odbc.OdbcConnection.HandleError(OdbcHandle hrHandle,
RetCode retcode)
       at System.Data.Odbc.OdbcCommand.ExecuteReaderObject(CommandBehavior
behavior, String method, Boolean needReader, Object[] methodArguments,
SQL_API odbcApiMethod)
       at System.Data.Odbc.OdbcCommand.ExecuteReaderObject(CommandBehavior
behavior, String method, Boolean needReader)
       at System.Data.Odbc.OdbcCommand.ExecuteReader(CommandBehavior
behavior)
       at DrillExplorer.DROdbcProvider.GetStatmentColumns(String in_query)

The part-r-001 file are of ORC format.

Is there anything fix? Thanks a lot!

Re: Apache drill validation error, table not found

Posted by Sorabh Hamirwasia <sh...@mapr.com>.
Hi,

Can you please try following instruction here [1] once.? Also after configuration you can try to list tables by "show databases" to make sure setup is fine.


And the query should be:

SELECT * FROM s3.`./data/part-r-001` LIMIT 100


[1]: https://drill.apache.org/docs/s3-storage-plugin/


Thanks,
Sorabh


________________________________
From: Bo Qiang <bo...@nielsen.com>
Sent: Monday, February 5, 2018 9:17 PM
To: user@drill.apache.org
Subject: Apache drill validation error, table not found

I have been trying to use Apache drill to query data in s3 buckets. Inside
of Drill Explorer, I met the following errors:

    ERROR [HY000] [MapR][Drill] (1040) Drill failed to execute the query:
SELECT * FROM `s3`.`default`.`./data/part-r-001` LIMIT 100
    [30034]Query execution error. Details:[
    VALIDATION ERROR: From line 1, column 15 to line 1, column 18: Table
's3.default../data/part-r-001' not found

    SQL Query null

    [Error Id: fa18496f-038f-46b1-9d3f-c40809511768 on 10.23.58.220:31010]
    ]
       at System.Data.Odbc.OdbcConnection.HandleError(OdbcHandle hrHandle,
RetCode retcode)
       at System.Data.Odbc.OdbcCommand.ExecuteReaderObject(CommandBehavior
behavior, String method, Boolean needReader, Object[] methodArguments,
SQL_API odbcApiMethod)
       at System.Data.Odbc.OdbcCommand.ExecuteReaderObject(CommandBehavior
behavior, String method, Boolean needReader)
       at System.Data.Odbc.OdbcCommand.ExecuteReader(CommandBehavior
behavior)
       at DrillExplorer.DROdbcProvider.GetStatmentColumns(String in_query)

The part-r-001 file are of ORC format.

Is there anything fix? Thanks a lot!