You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Venki Korukanti (JIRA)" <ji...@apache.org> on 2015/01/19 18:24:35 UTC

[jira] [Created] (DRILL-2034) Use the correct schema when creating FileSystem object in HiveScan

Venki Korukanti created DRILL-2034:
--------------------------------------

             Summary: Use the correct schema when creating FileSystem object in HiveScan
                 Key: DRILL-2034
                 URL: https://issues.apache.org/jira/browse/DRILL-2034
             Project: Apache Drill
          Issue Type: Bug
          Components: Storage - Hive
            Reporter: Venki Korukanti
            Assignee: Venki Korukanti
             Fix For: 0.8.0


We currently get the FileSystem object using FileSystem.get(JobConf) which always returns the FileSystem implementation of default FS setting in conf. This causes problem when Hive MetaStore has tables stored in different storages. For example one table has data on HDFS and other on S3 filesystem. 

{code}
        Path path = new Path(table.getSd().getLocation());
        FileSystem fs = FileSystem.get(job);
        if (fs.exists(path)) {
           ....
{code}

We should call Path.getFileSystem() which takes the URI schema from the path.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)