[jira] [Commented] (HIVE-18341) Add repl load support for adding "raw" namespace for TDE with same encryption keys

["Thejas M Nair (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-18341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304257#comment-16304257 ] 

Thejas M Nair commented on HIVE-18341:
--------------------------------------

[~anishek]
My understanding is that the use of /.reserved/raw just leads to an optimization where decryption and reencryption is skipped for distcp, and just copies raw bytes. So it would work even without it (just slower).
cc [~shwethags] [~venkatnrangan] 

> Add repl load support for adding "raw" namespace for TDE with same encryption keys
> ----------------------------------------------------------------------------------
>
>                 Key: HIVE-18341
>                 URL: https://issues.apache.org/jira/browse/HIVE-18341
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 3.0.0
>            Reporter: anishek
>            Assignee: anishek
>             Fix For: 3.0.0
>
>         Attachments: HIVE-18341.0.patch
>
>
> https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html#Running_as_the_superuser
> "a new virtual path prefix, /.reserved/raw/, that gives superusers direct access to the underlying block data in the filesystem. This allows superusers to distcp data without needing having access to encryption keys, and also avoids the overhead of decrypting and re-encrypting data."
> We need to introduce a new option in "Repl Load" command that will change the files being copied in distcp to have this "/.reserved/raw/" namespace before the file paths.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)