You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Victoria Markman (JIRA)" <ji...@apache.org> on 2015/09/01 02:52:46 UTC
[jira] [Created] (DRILL-3729) Remove info message about invalid
argument during query planning where filter is a directory
Victoria Markman created DRILL-3729:
---------------------------------------
Summary: Remove info message about invalid argument during query planning where filter is a directory
Key: DRILL-3729
URL: https://issues.apache.org/jira/browse/DRILL-3729
Project: Apache Drill
Issue Type: Bug
Reporter: Victoria Markman
I hit this INFO/exception during query planning.
It sounds like that we are treating directory (2015) as if it was a parquet file. It would be nice to get rid of an exception in the log file - it is misleading.
{code}
explain plan for select l_orderkey from dfs.`/drill/testdata/adt/lineitem` l1 where l1.dir0 = '2015'
{code}
{code}
2015-08-31 23:36:15,714 [2a1b1b0f-a703-2f9b-8697-8997d5ca00b1:foreman] INFO o.a.d.e.store.mock.MockStorageEngine - Failure while attempting to check for Parquet metadata file.
java.io.IOException: Open failed for file: /drill/testdata/adt/lineitem/2015, error: Invalid argument (22)
at com.mapr.fs.MapRClientImpl.open(MapRClientImpl.java:212) ~[maprfs-4.1.0-mapr.jar:4.1.0-mapr]
at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:853) ~[maprfs-4.1.0-mapr.jar:4.1.0-mapr]
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:800) ~[hadoop-common-2.5.1-mapr-1503.jar:na]
at org.apache.drill.exec.store.dfs.DrillFileSystem.open(DrillFileSystem.java:128) ~[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.store.dfs.BasicFormatMatcher$MagicStringMatcher.matches(BasicFormatMatcher.java:139) ~[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.store.dfs.BasicFormatMatcher.isReadable(BasicFormatMatcher.java:108) ~[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.store.parquet.ParquetFormatPlugin$ParquetFormatMatcher.isDirReadable(ParquetFormatPlugin.java:226) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.store.parquet.ParquetFormatPlugin$ParquetFormatMatcher.isReadable(ParquetFormatPlugin.java:206) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.create(WorkspaceSchemaFactory.java:291) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.create(WorkspaceSchemaFactory.java:118) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.planner.sql.ExpandingConcurrentMap.getNewEntry(ExpandingConcurrentMap.java:96) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.planner.sql.ExpandingConcurrentMap.get(ExpandingConcurrentMap.java:90) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.getTable(WorkspaceSchemaFactory.java:241) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.store.dfs.FileSystemSchemaFactory$FileSystemSchema.getTable(FileSystemSchemaFactory.java:117) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.calcite.jdbc.SimpleCalciteSchema.getTable(SimpleCalciteSchema.java:83) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.prepare.CalciteCatalogReader.getTableFrom(CalciteCatalogReader.java:116) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:99) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:70) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.EmptyScope.getTableNamespace(EmptyScope.java:75) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.DelegatingScope.getTableNamespace(DelegatingScope.java:124) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:104) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:876) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:862) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2776) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2761) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2984) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:876) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:862) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:210) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:836) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:550) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.prepare.PlannerImpl.validate(PlannerImpl.java:177) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.calcite.prepare.PlannerImpl.validateAndGetType(PlannerImpl.java:188) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode(DefaultSqlHandler.java:431) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateAndConvert(DefaultSqlHandler.java:191) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.planner.sql.handlers.ExplainHandler.getPlan(ExplainHandler.java:56) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:178) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:903) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:242) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_71]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_71]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_71]
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)