[jira] [Comment Edited] (DRILL-6454) Native MapR DB plugin support for Hive MapR-DB json table

["Bridget Bevens (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522841#comment-16522841 ] 

Bridget Bevens edited comment on DRILL-6454 at 6/25/18 9:52 PM:
----------------------------------------------------------------

Hi [~vitalii],

Thank you for adding the doc notes to the description. 
Can you please review the following description for the store.hive.maprdb_json.optimize_scan_with_native_reader option?

Description:
When you enable the store.hive.maprdb_json.optimize_scan_with_native_reader option, Drill can use the native Drill reader to read [Hive external tables that were created from MapR-DB JSON tables|https://maprdocs.mapr.com/home/Hive/ConnectingToMapR-DB.html]. The native Drill reader enables Drill to perform faster reads of data and filter pushdown optimizations.  

Thanks,

Bridget



was (Author: bbevens):
Hi [~vitalii],

I have a couple of doc questions regarding this JIRA.
1)	Do we want to document the *store.hive.parquet.optimize_scan_with_native_readers* option or wait until Drill 1.15 to tell users that the name has changed from *store.hive.optimize_scan_with_native_readers* to *store.hive.parquet.optimize_scan_with_native_readers*? 

2)	Do we need to document this new option? *store.hive.maprdb_json.optimize_scan_with_native_reader*  
If yes, is this option disabled by default?
What does the option do? 
Example Description:
When you enable the *store.hive.maprdb_json.optimize_scan_with_native_reader* option, Drill uses the native Drill reader to read Hive external tables that were created from MapR-DB JSON tables. The native Drill reader enables Drill to perform faster reads of data and filter pushdown optimizations.

Thanks,
Bridget



> Native MapR DB plugin support for Hive MapR-DB json table
> ---------------------------------------------------------
>
>                 Key: DRILL-6454
>                 URL: https://issues.apache.org/jira/browse/DRILL-6454
>             Project: Apache Drill
>          Issue Type: New Feature
>          Components: Storage - Hive, Storage - MapRDB
>    Affects Versions: 1.13.0
>            Reporter: Vitalii Diravka
>            Assignee: Vitalii Diravka
>            Priority: Major
>              Labels: doc-impacting, ready-to-commit
>             Fix For: 1.14.0
>
>
> Hive can create and query MapR-DB tables via maprdb-json-handler:
>  [https://maprdocs.mapr.com/home/Hive/ConnectingToMapR-DB.html]
> The aim of this Jira to implement Drill native reader for Hive MapR-DB tables (similar to parquet).
> Design proposal is:
>  - to use JsonTableGroupScan instead of HiveScan;
>  - to add storage planning rule to convert HiveScan to MapRDBGroupScan;
>  - to add system/session option to enable using of this native reader;
>  - native reader can be used only for Drill build with mapr profile (there is no reason to leverage it for default profile);
>  
> *For documentation:*
> two new options were added:
> store.hive.parquet.optimize_scan_with_native_reader: false,
> store.hive.maprdb_json.optimize_scan_with_native_reader: false,
> store.hive.parquet.optimize_scan_with_native_reader is new option used instead of store.hive.optimize_scan_with_native_readers. The latter is deprecated and will be removed in 1.15.
> (https://issues.apache.org/jira/browse/DRILL-6527).
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)