RE: Anyone know how to mock a secured hdfs for unit test?

["Zheng, Kai" <ka...@intel.com>]

Hi Chris,

Thanks for your great info. I would paste it in the JIRA for future reference if I or somebody else get the chance to work on it. 

Regards,
Kai

-----Original Message-----
From: Chris Nauroth [mailto:cnauroth@hortonworks.com] 
Sent: Saturday, June 28, 2014 4:27 AM
To: security@hadoop.apache.org
Cc: yarn-dev@hadoop.apache.org; hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org; yarn-issues@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
Subject: Re: Anyone know how to mock a secured hdfs for unit test?

Hi David and Kai,

There are a couple of challenges with this, but I just figured out a pretty decent setup while working on HDFS-2856.  That code isn't committed yet, but if you open patch version 5 attached to that issue and look for the TestSaslDataTransfer class, then you'll see how it works.  Most of the logic for bootstrapping a MiniKDC and setting up the right HDFS configuration properties is in an abstract base class named SaslDataTransferTestCase.

I hope this helps.

There are a few other open issues out there related to tests in secure mode.  I know of HDFS-4312 and HDFS-5410.  It would be great to get more regular test coverage with something that more closely approximates a secured deployment.

Chris Nauroth
Hortonworks
http://hortonworks.com/



On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai <ka...@intel.com> wrote:

> Hi David,
>
> Quite some time ago I opened HADOOP-9952 and planned to create secured 
> MiniClusters by making use of MiniKDC. Unfortunately since then I 
> didn't get the chance to work on it yet. If you need something like 
> that and would contribute, please let me know and see if anything I can help with. Thanks.
>
> Regards,
> Kai
>
> -----Original Message-----
> From: Liu, David [mailto:liujiong25@gmail.com]
> Sent: Thursday, June 26, 2014 10:12 PM
> To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org; 
> yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org; 
> mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
> Subject: Anyone know how to mock a secured hdfs for unit test?
>
> Hi all,
>
> I need to test my code which read data from secured hdfs, is there any 
> library to mock secured hdfs, can minihdfscluster do the work?
> Any suggestion is appreciated.
>
>
> Thanks
>

--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.