You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org> on 2011/07/27 23:37:12 UTC

[jira] [Commented] (HIVE-2318) Support multiple file systems

    [ https://issues.apache.org/jira/browse/HIVE-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072036#comment-13072036 ] 

jiraposter@reviews.apache.org commented on HIVE-2318:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1210/
-----------------------------------------------------------

Review request for hive.


Summary
-------

Support multiple file systems


This addresses bug HIVE-2318.
    https://issues.apache.org/jira/browse/HIVE-2318


Diffs
-----

  ql/src/java/org/apache/hadoop/hive/ql/Context.java 1a1ffc5 
  ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java c031f40 
  ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java c9e61a1 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java c6f6755 
  ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java a57f9cf 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRFileSink1.java 092a5cd 
  ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 337a8eb 
  ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java 3001575 
  ql/src/java/org/apache/hadoop/hive/ql/parse/LoadSemanticAnalyzer.java 6f311c6 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java e1febc3 
  ql/src/java/org/apache/hadoop/hive/ql/plan/ConditionalResolverMergeFiles.java 5c09789 
  ql/src/java/org/apache/hadoop/hive/ql/plan/DynamicPartitionCtx.java 29cfe9d 

Diff: https://reviews.apache.org/r/1210/diff


Testing
-------


Thanks,

Vaibhav



> Support multiple file systems
> -----------------------------
>
>                 Key: HIVE-2318
>                 URL: https://issues.apache.org/jira/browse/HIVE-2318
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Vaibhav Aggarwal
>            Assignee: Vaibhav Aggarwal
>
> Currently some of the Hive tasks like MoveTask, ConditionalMergeResolver assume that the data is being copied or moved on the same file system.
> These operators file if the source table is in one filesystem (like HDFS) and destination table is in another file system (like s3).
> This patch aims at:
> 1. Support moving data between different file systems.
> 2. Add support for file systems which do not support 'move' operation like s3.
> 3. Remove redundant operations like moving data from and to the same location.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira