You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Kunal Khatua (JIRA)" <ji...@apache.org> on 2018/07/17 19:06:00 UTC

[jira] [Commented] (DRILL-6614) Allowing usage of MapRDBFormatPlugin for HiveStoragePlugin

    [ https://issues.apache.org/jira/browse/DRILL-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16546993#comment-16546993 ] 

Kunal Khatua commented on DRILL-6614:
-------------------------------------

This was the stacktrace observed:
{code}
0: jdbc:drill:schema=hive> select * from lineitem where l_orderkey > 0 limit 1;
Error: SYSTEM ERROR: ClassCastException: org.apache.drill.exec.store.hive.HiveStoragePluginConfig cannot be cast to org.apache.drill.exec.store.dfs.FileSystemConfig


[Error Id: 1ce755b4-65b6-41bf-a7c2-ff488b1d15fc on mperf206.qa.lab:31010]

  (org.apache.drill.exec.work.foreman.ForemanException) Unexpected exception during fragment initialization: Error while applying rule DbScanToIndexScanPrule:Filter_On_Scan, args [rel#1813:DrillFilterRel.LOGICAL.ANY([]).[](input=rel#1812:Subset#4.LOGICAL.ANY([]).[],condition=>($1, 0)), rel#1821:DrillScanRel.LOGICAL.ANY([]).[](table=[hive, lineitem],groupscan=JsonTableGroupScan [ScanSpec=JsonScanSpec [tableName=/drill/testdata/tpch/sf100/maprdb/json/lineitem, condition=null], columns=[`**`], maxwidth=3576])]
    org.apache.drill.exec.work.foreman.Foreman.run():294
    java.util.concurrent.ThreadPoolExecutor.runWorker():1142
    java.util.concurrent.ThreadPoolExecutor$Worker.run():617
    java.lang.Thread.run():745
  Caused By (java.lang.RuntimeException) Error while applying rule DbScanToIndexScanPrule:Filter_On_Scan, args [rel#1813:DrillFilterRel.LOGICAL.ANY([]).[](input=rel#1812:Subset#4.LOGICAL.ANY([]).[],condition=>($1, 0)), rel#1821:DrillScanRel.LOGICAL.ANY([]).[](table=[hive, lineitem],groupscan=JsonTableGroupScan [ScanSpec=JsonScanSpec [tableName=/drill/testdata/tpch/sf100/maprdb/json/lineitem, condition=null], columns=[`**`], maxwidth=3576])]
    org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch():236
    org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp():652
    org.apache.calcite.tools.Programs$RuleSetProgram.run():368
    org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():434
    org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToPrel():464
    org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():181
    org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan():145
    org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():83
    org.apache.drill.exec.work.foreman.Foreman.runSQL():567
    org.apache.drill.exec.work.foreman.Foreman.run():266
    java.util.concurrent.ThreadPoolExecutor.runWorker():1142
    java.util.concurrent.ThreadPoolExecutor$Worker.run():617
    java.lang.Thread.run():745
  Caused By (java.lang.ClassCastException) org.apache.drill.exec.store.hive.HiveStoragePluginConfig cannot be cast to org.apache.drill.exec.store.dfs.FileSystemConfig
    org.apache.drill.exec.store.mapr.db.MapRDBGroupScan.getStorageConfig():274
    org.apache.drill.exec.store.mapr.db.MapRDBGroupScan.getSecondaryIndexCollection():314
    org.apache.drill.exec.planner.index.rules.DbScanToIndexScanPrule.getIndexCollection():301
    org.apache.drill.exec.planner.index.rules.DbScanToIndexScanPrule.doOnMatch():258
    org.apache.drill.exec.planner.index.rules.DbScanToIndexScanPrule.onMatch():120
    org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch():212
    org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp():652
    org.apache.calcite.tools.Programs$RuleSetProgram.run():368
    org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.transform():434
    org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToPrel():464
    org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():181
    org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan():145
    org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():83
    org.apache.drill.exec.work.foreman.Foreman.runSQL():567
    org.apache.drill.exec.work.foreman.Foreman.run():266
    java.util.concurrent.ThreadPoolExecutor.runWorker():1142
    java.util.concurrent.ThreadPoolExecutor$Worker.run():617
    java.lang.Thread.run():745 (state=,code=0)
{code}

> Allowing usage of MapRDBFormatPlugin for HiveStoragePlugin
> ----------------------------------------------------------
>
>                 Key: DRILL-6614
>                 URL: https://issues.apache.org/jira/browse/DRILL-6614
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Hive, Storage - MapRDB
>    Affects Versions: 1.14.0
>            Reporter: Vitalii Diravka
>            Assignee: Vitalii Diravka
>            Priority: Major
>             Fix For: 1.14.0
>
>
> Allowing usage of MapRDBFormatPlugin for HiveStoragePlugin and HiveStoragePluginConfig for MapRDBGroupScan was introduced in DRILL-6454.
> This ticket aims to cover all cases for above issues.
> The issues are related to the following methods: 
> {{StoragePluginRegistryImpl.getFormatPlugin(), }}{{MapRDBGroupScan.getStorageConfig()}}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)