You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by praveenesh kumar <pr...@gmail.com> on 2018/01/25 16:22:30 UTC
Anyone has tried accessing TDE using HDFS Java APIs
Hi
We are trying to access TDE files using HDFS JAVA API. The user which is
running the job has access to the TDE zone. We have tried accessing the
file successfully in Hadoop FS Command shell.
If we pass the same file in spark using the same user, it also gets read
properly.
Its just when we are trying to use the vanila HDFS APIs, its not able to
pick the file. And when it picks, its not able to decipher the text. The
data is not getting decrypted. My understanding is when you pass
hdfs-site.xml, core-site.xml and kms-site.xml to the configuration object,
it should be able to handle keys automatically.
Not sure if we need to do anything extra in JAVA API. Any pointers. There
aren't a single example in the documentation to get the TDE files via HDFS
Java API.
Any suggestions would be much appreciated.
Regards
Prav
Re: Anyone has tried accessing TDE using HDFS Java APIs
Posted by praveenesh kumar <pr...@gmail.com>.
Hi Ajay
Did you get any chance to look into this. Thanks
Regards
Prav
On Fri, Jan 26, 2018 at 8:48 AM, praveenesh kumar <pr...@gmail.com>
wrote:
> Hi Ajay
>
> We are using HDP 2.5.5 with HDFS 2.7.1.2.5
>
> Thanks
> Prav
>
> On Thu, Jan 25, 2018 at 5:47 PM, Ajay Kumar <aj...@hortonworks.com>
> wrote:
>
>> Hi Praveenesh,
>>
>>
>>
>> What version of Hadoop you are using?
>>
>>
>>
>> Thanks,
>>
>> Ajay
>>
>>
>>
>> *From: *praveenesh kumar <pr...@gmail.com>
>> *Date: *Thursday, January 25, 2018 at 8:22 AM
>> *To: *"user@hadoop.apache.org" <us...@hadoop.apache.org>
>> *Subject: *Anyone has tried accessing TDE using HDFS Java APIs
>>
>>
>>
>> Hi
>>
>>
>>
>> We are trying to access TDE files using HDFS JAVA API. The user which is
>> running the job has access to the TDE zone. We have tried accessing the
>> file successfully in Hadoop FS Command shell.
>>
>>
>>
>> If we pass the same file in spark using the same user, it also gets read
>> properly.
>>
>>
>>
>> Its just when we are trying to use the vanila HDFS APIs, its not able to
>> pick the file. And when it picks, its not able to decipher the text. The
>> data is not getting decrypted. My understanding is when you pass
>> hdfs-site.xml, core-site.xml and kms-site.xml to the configuration object,
>> it should be able to handle keys automatically.
>>
>>
>>
>> Not sure if we need to do anything extra in JAVA API. Any pointers. There
>> aren't a single example in the documentation to get the TDE files via HDFS
>> Java API.
>>
>>
>>
>> Any suggestions would be much appreciated.
>>
>>
>>
>> Regards
>>
>> Prav
>>
>
>
Re: Anyone has tried accessing TDE using HDFS Java APIs
Posted by praveenesh kumar <pr...@gmail.com>.
Hi Ajay
We are using HDP 2.5.5 with HDFS 2.7.1.2.5
Thanks
Prav
On Thu, Jan 25, 2018 at 5:47 PM, Ajay Kumar <aj...@hortonworks.com>
wrote:
> Hi Praveenesh,
>
>
>
> What version of Hadoop you are using?
>
>
>
> Thanks,
>
> Ajay
>
>
>
> *From: *praveenesh kumar <pr...@gmail.com>
> *Date: *Thursday, January 25, 2018 at 8:22 AM
> *To: *"user@hadoop.apache.org" <us...@hadoop.apache.org>
> *Subject: *Anyone has tried accessing TDE using HDFS Java APIs
>
>
>
> Hi
>
>
>
> We are trying to access TDE files using HDFS JAVA API. The user which is
> running the job has access to the TDE zone. We have tried accessing the
> file successfully in Hadoop FS Command shell.
>
>
>
> If we pass the same file in spark using the same user, it also gets read
> properly.
>
>
>
> Its just when we are trying to use the vanila HDFS APIs, its not able to
> pick the file. And when it picks, its not able to decipher the text. The
> data is not getting decrypted. My understanding is when you pass
> hdfs-site.xml, core-site.xml and kms-site.xml to the configuration object,
> it should be able to handle keys automatically.
>
>
>
> Not sure if we need to do anything extra in JAVA API. Any pointers. There
> aren't a single example in the documentation to get the TDE files via HDFS
> Java API.
>
>
>
> Any suggestions would be much appreciated.
>
>
>
> Regards
>
> Prav
>
Re: Anyone has tried accessing TDE using HDFS Java APIs
Posted by Ajay Kumar <aj...@hortonworks.com>.
Hi Praveenesh,
What version of Hadoop you are using?
Thanks,
Ajay
From: praveenesh kumar <pr...@gmail.com>
Date: Thursday, January 25, 2018 at 8:22 AM
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Subject: Anyone has tried accessing TDE using HDFS Java APIs
Hi
We are trying to access TDE files using HDFS JAVA API. The user which is running the job has access to the TDE zone. We have tried accessing the file successfully in Hadoop FS Command shell.
If we pass the same file in spark using the same user, it also gets read properly.
Its just when we are trying to use the vanila HDFS APIs, its not able to pick the file. And when it picks, its not able to decipher the text. The data is not getting decrypted. My understanding is when you pass hdfs-site.xml, core-site.xml and kms-site.xml to the configuration object, it should be able to handle keys automatically.
Not sure if we need to do anything extra in JAVA API. Any pointers. There aren't a single example in the documentation to get the TDE files via HDFS Java API.
Any suggestions would be much appreciated.
Regards
Prav