You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Abdullah Yousufi (JIRA)" <ji...@apache.org> on 2016/08/17 20:48:20 UTC

[jira] [Created] (HIVE-14560) Support exchange partition between s3 and hdfs tables

Abdullah Yousufi created HIVE-14560:
---------------------------------------

             Summary: Support exchange partition between s3 and hdfs tables
                 Key: HIVE-14560
                 URL: https://issues.apache.org/jira/browse/HIVE-14560
             Project: Hive
          Issue Type: Bug
            Reporter: Abdullah Yousufi
            Assignee: Abdullah Yousufi
             Fix For: 2.2.0


{code}
alter table s3_tbl exchange partition (country='USA', state='CA') with table hdfs_tbl;
{code}
results in:
{code}
Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:Got exception: java.lang.IllegalArgumentException Wrong FS: s3a://hive-on-s3/s3_tbl/country=USA/state=CA, expected: hdfs://localhost:9000) (state=08S01,code=1)
{code}
because the check for whether the s3 destination table path exists occurs on the hdfs filesystem.

Furthermore, exchanging between s3 to hdfs fails because the hdfs rename operation is not supported across filesystems. Fix uses copy + deletion in the case that the file systems differ.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)