You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@drill.apache.org by "Timothy Farkas (JIRA)" <ji...@apache.org> on 2018/07/13 23:16:00 UTC

[jira] [Created] (DRILL-6609) Investigate Creation of FileSystem Configuration for Hive Parquet Files

Timothy Farkas created DRILL-6609:
-------------------------------------

             Summary: Investigate Creation of FileSystem Configuration for Hive Parquet Files
                 Key: DRILL-6609
                 URL: https://issues.apache.org/jira/browse/DRILL-6609
             Project: Apache Drill
          Issue Type: Task
            Reporter: Timothy Farkas


Currently when reading a parquet file in Hive we try to speed things up by doing a native parquet scan with HiveDrillNativeParquetRowGroupScan. When retrieving the FileSystem Configuration to use in HiveDrillNativeParquetRowGroupScan.getFsConf, use all the properties defined for the HiveStoragePlugin. This could cause a misconfiguration in the HiveStoragePlugin to influence the configuration of our FileSystem.

Currently it is unclear if this was desired behavior or not. If it is desired we need to document why it was done. If it is not desired we need to fix the issue.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)